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Preface 



A control system is a dynamical system on which one can act by using suitable 
controls. There are a lot of problems that appear when studying a control system. 
But the most common ones are the controllability problem and the stabilization 
problem. 

The controllability problem is, roughly speaking, the following one. Let us give 
two states. Is it possible to move the control system from the first one to the second 
one? We study this problem in Part [l] and in Part [5] Part [l] studies the control- 
lability of linear control systems, where the situation is rather well understood, 
even if there are still quite challenging open problems in the case of linear partial 
differential control systems. In Part [2] we are concerned with the controllability 
of nonlinear control systems. We start with the case of finite-dimensional control 
systems, a case where quite powerful geometrical tools are known. The case of 
nonlinear partial differential equations is much more complicated to handle. We 
present various methods to treat this case as well as many applications of these 
methods. We emphasize control systems for which the nonlinearity plays a crucial 
role, in particular, for which it is the nonlinearity that gives the controllability or 
prevents achieving some specific interesting motions. 

The stabilization problem is the following one. We have an equilibrium which 
is unstable without the use of the control. Let us give a concrete example. One 
has a stick that is placed vertically on one of his fingers. In principle, if the stick is 
exactly vertical with a speed exactly equal to 0, it should remain vertical. But, due 
to various small errors (the stick is not exactly vertical, for example), in practice, 
the stick falls down. In order to avoid this, one moves the finger in a suitable 
way, depending on the position and speed of the stick; we use a "feedback law" 
(or "closed-loop control 11 ) which stabilizes the equilibrium. The problem of the 
stabilization is the existence and construction of such stabilizing feedback laws 
for a given control system. We study it in Part [31 both for finite-dimensional 
control systems and for systems modeled by partial differential equations. Again 
we emphasize the case where the nonlinear terms play a crucial role. 

Let us now be more precise on the contents of the different parts of this book. 

Part [TJ Controllability of linear control systems 

This first part is devoted to the controllability of linear control systems. It has two 
chapters: The first one deals with finite-dimensional control systems, the second 
one deals with infinite-dimensional control systems modeled by partial differential 
equations. 

Let us detail the contents of these two chapters. 
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Chapter [TJ This chapter focuses on the controllability of linear finite- dimensional 
control systems. We first give an integral necessary and sufficient condition for 
a linear time-varying finite-dimensional control system to be controllable. For a 
special quadratic cost, it leads to the optimal control. We give some examples of 
applications. 

These examples show that the use of this necessary and sufficient condition can 
lead to computations which are somewhat complicated even for very simple control 
systems. In particular, it requires integrating linear differential equations. We 
present the famous Kalman rank condition for the controllability of linear time- 
invariant finite-dimensional control systems. This new condition, which is also 
necessary and sufficient for controllability, is purely algebraic: it does not require 
integrations of linear differential equations. We turn then to the case of linear time- 
varying finite-dimensional control systems. For these systems we give a sufficient 
condition for controllability, which turns out to be also necessary for analytic control 
systems. This condition only requires computing derivatives; again no integrations 
are needed. 

We describe, in the framework of linear time- varying finite-dimensional control 
systems, the Hilbert Uniqueness Method (HUM), due to Jacques-Louis Lions. This 
method is quite useful in infinite dimension for finding numerically optimal controls 
for linear control systems. 

Chapter [2l The subject of this chapter is the controllability of some classical linear 
partial differential equations. For the reader who is familiar with this subject, a 
large part of this chapter can be omitted; most of the methods detailed here are 
very well known. One can find much more advanced material in some references 
given throughout this chapter. We study a transport equation, a Korteweg-de Vries 
equation, a heat equation, a wave equation and a Schrodinger equation. 

We prove the well-posedness of the Cauchy problem associated to these equa- 
tions. The controllability of these equations is studied by means of various methods: 
explicit methods, extension method, moments theory, flatness, Hilbert Uniqueness 
Method, duality between controllability and observability. This duality shows that 
the controllability can be reduced to an observability inequality. We show how 
to prove this inequality by means of the multiplier method or Carleman inequal- 
ities. We also present a classical abstract setting which allows us to treat the 
well-posedness and the controllability of many partial differential equations in the 
same framework. 

Part |2} Controllability of nonlinear control systems 

This second part deals with the controllability of nonlinear control systems. 

We start with the case of nonlinear finite-dimensional control systems. We 
recall the linear test and explain some geometrical methods relying on iterated Lie 
brackets when this test fails. 

Next we consider nonlinear partial differential equations. For these infinite- 
dimensional control systems, we begin with the case where the linearized control 
system is controllable. Then we get local controllability results and even global 
controllability results if the nonlinearity is not too big. The case where the linearized 
control system is not controllable is more difficult to handle. In particular, the 
tool of iterated Lie brackets, which is quite useful for treating this case in finite 
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dimension, turns out to be useless for many interesting infinite-dimensional control 
systems. We present three methods to treat some of these systems, namely the 
return method, quasi-static deformations and power series expansions. On various 
examples, we show how these three methods can be used. 

Let us give more details on the contents of the seven chapters of Part [2] 

Chapter [3j In this chapter we study the local controllability of finite- dimensional 
nonlinear control systems around a given equilibrium. One does not know any in- 
teresting necessary and sufficient condition for small-time local controllability, even 
for analytic control systems. However, one knows powerful necessary conditions 
and powerful sufficient conditions. 

We recall the classical "linear test" : If the linearized control system at the 
equilibrium is controllable, then the nonlinear control system is locally controllable 
at this equilibrium. 

When the linearized control system is not controllable, the situation is much 
more complicated. We recall the Lie algebra condition, a necessary condition for 
local controllability of (analytic) control systems. It relies on iterated Lie brackets. 
We explain why iterated Lie brackets are natural for the problem of controllability. 

We study in detail the case of the driftless control systems. For these systems, 
the above Lie algebra rank condition turns out to be sufficient, even for global 
controllability. 

Among the iterated Lie brackets, we describe some of them which are "good" 
and give the small-time local controllability, and some of them which are "bad" 
and lead to obstructions to small-time local controllability. 

Chapter HI In this chapter, we first consider the problem of the controllability 
around an equilibrium of a nonlinear partial differential equation such that the 
linearized control system around the equilibrium is controllable. In finite dimension, 
we have already seen that, in such a situation, the nonlinear control system is 
locally controllable around the equilibrium. Of course in infinite dimension one 
expects that a similar result holds. We prove that this is indeed the case for 
various equations: A nonlinear Korteweg-de Vries equation, a nonlinear hyperbolic 
equation and a nonlinear Schrodinger equation. For the first equation, one uses 
a natural fixed-point method. For the two other equations, the situation is more 
involved due to a problem of loss of derivatives. For the hyperbolic equation, one 
uses, to take care of this problem, an ad-hoc fixed-point method, which is specific 
to hyperbolic systems. For the case of the Schrodinger equation, this problem is 
overcome by the use of a Nash-Moser method. 

Sometimes these methods, which lead to local controllability results, can be 
adapted to give a global controllability result if the nonlinearity is not too big at 
infinity. We present an example for a nonlinear one-dimensional wave equation. 

Chapter [5l We present an application of the use of iterated Lie brackets for a 
nonlinear partial differential equation (a nonlinear Schrodinger equation). We also 
explain why iterated Lie brackets are less powerful in infinite dimension than in 
finite dimension. 
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Chapter [6j This chapter deals with the return method. The idea of the return 
method goes as follows: If one can find a trajectory of the nonlinear control system 
such that: 

- it starts and ends at the equilibrium, 

- the linearized control system around this trajectory is controllable, 

then, in general, the implicit function theorem implies that one can go from every 
state close to the equilibrium to every other state close to the equilibrium. In 
Chapter [6] we sketch some results in flow control which have been obtained by this 
method, namely: 

- global controllability results for the Euler equations of incompressible fluids, 

- global controllability results for the Navier-Stokes equations of incompress- 
ible fluids, 

- local controllability of a 1-D tank containing a fluid modeled by the shallow 
water equations. 

Chapter W\ This chapter develops the quasi-static deformation method, which 
allows one to prove in some cases that one can move from a given equilibrium to 
another given equilibrium if these two equilibria are connected in the set of equi- 
libria. The idea is just to move very slowly the control (quasi-static deformation) 
so that at each time the state is close to the curve of equilibria connecting the two 
given equilibria. If some of these equilibria are unstable, one also uses suitable feed- 
back laws in order to stabilize them; without these feedback laws the quasi-static 
deformation method would not work. We present an application to a semilinear 
heat equation. 

Chapter [8[ This chapter is devoted to the power series expansion method: One 
makes some power series expansion in order to decide whether the nonlinearity 
allows us to move in every (oriented) direction which is not controllable for the 
linearized control system around the equilibrium. We present an application to a 
nonlinear Korteweg-de Vries equation. 

Chapter KM The previous three methods (return, quasi-static deformations, power 
series expansion) can be used together. We present in this chapter an example for 
a nonlinear Schrodinger control equation. 

Part OD Stabilization 

The two previous parts were devoted to the controllability problem, which asks if 
one can move from a first given state to a second given state. The control that 
one gets is an open-loop control: it depends on time and on the two given states, 
but it does not depend on the state during the evolution of the control system. 
In many practical situations one prefers closed- loop controls, i.e., controls which 
do not depend on the initial state but depend, at time t, on the state x at this 
time. One requires that these closed-loop controls (asymptotically) stabilize the 
point one wants to reach. Usually such closed-loop controls (or feedback laws) have 
the advantage of being be more robust to disturbances (recall the experiment of 
the stick on the finger). The main issue discussed in this part is the problem of 
deciding whether a controllable system can be (asymptotically) stabilized. 
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This part is divided into four chapters: Chapter |10| Chapter |11| Chapter |12| 
and Chapter |13| which we now briefly describe. 



Chapter |10| This chapter is mainly concerned with the stabilization of finite- 
dimensional linear control systems. We first start by recalling the classical pole- 
shifting theorem. A consequence of this theorem is that every controllable linear 
system can be stabilized by means of linear feedback laws. This implies that, if 
the linearized control system at an equilibrium of a nonlinear control system is 
controllable, then this equilibrium can be stabilized by smooth feedback laws. 



Chapter |11[ This chapter discusses the stabilization of finite- dimensional non- 
linear control systems, mainly in the case where the nonlinearity plays a key role. 
In particular, it deals with the case where the linearized control system around 
the equilibrium that one wants to stabilize is no longer controllable. Then there 
are obstructions to stabilizability by smooth feedback laws even for controllable 
systems. We recall some of these obstructions. There are two ways to enlarge the 
class of feedback laws in order to recover stabilizability properties. The first one is 
the use of discontinuous feedback laws. The second one is the use of time- varying 
feedback laws. We give only comments and references on the first method, but we 
give details on the second one. We also show the interest of time-varying feedback 
laws for output stabilization: In this case the feedback laws depend only on the 
output, which is only part of the state. 



Chapter 12, In this chapter, we present important tools for constructing explicit 



stabilizing feedback laws, namely: 

1. control Lyapunov function, 

2. damping, 

3. homogeneity, 

4. averaging, 

5. backstepping, 

6. forwarding, 

7. transverse functions. 

These methods are illustrated on various control systems, in particular, the stabi- 
lization of the attitude of a rigid spacecraft. 



Chapter |13| In this chapter, we give examples of how some tools introduced for 
the stabilization of finite- dimensional control systems can be used to stabilize some 
partial differential equations. We treat the following four examples: 

1. rapid exponential stabilization by means of Gramians for linear time- rever- 
sible partial differential equations, 

2. stabilization of a rotating body-beam without damping, 

3. stabilization of the Euler equations of incompressible fluids, 

4. stabilization of hyperbolic systems. 
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Appendices 

This book has two appendices. In the first one (Appendix |A|, we recall some classi- 
cal results on semigroups generated by linear operators and classical applications to 
evolution equations. We omit the proofs but we give precise references where they 
can be found. In the second appendix (Appendix |B|, we construct the degree of a 
map and prove the properties of the degree we use in this book. As an application 
of the degree, we also prove the Brouwer and Schauder fixed-point theorems which 
are also used in this book. 
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Part 1 

Controllability of linear control 

systems 



This first part is devoted to the controllability of linear control systems. It has 
two chapters: The first one deals with finite-dimensional control systems, the second 
one deals with infinite-dimensional control systems modeled by partial differential 
equations. 

Let us detail the contents of these two chapters. 

Chapter [TJ This chapter focuses on the controllability of linear finite- dimensional 
control systems. We first give an integral necessary and sufficient condition (The- 
orem 1 1 . 1 1 1 on page pi for a linear time- varying finite-dimensional control system 
to be controllable. For a special quadratic cost, it leads to the optimal control 



(Proposition 1 1 . 1 3 on page pi). We give examples of applications. 

These examples show that the use of this necessary and sufficient condition 
can lead to computations which are somewhat complicated even for very simple 
control systems. In particular, it requires integrating linear differential equations. 
In Section 1.3 we first give the famous Kalman rank condition (Theorem 1.16 on 
pagep)]) for the controllability of linear time-invariant finite-dimensional control sys- 
tems. This new condition, which is also necessary and sufficient for controllability, 
is purely algebraic; it does not require integrations of linear differential equations. 
We turn then to the case of linear time-varying finite-dimensional control systems. 



For these systems we give a sufficient condition for controllability (Theorem 1.18 
on page 11 ), which turns out to be also necessary for analytic control systems. This 
condition only requires computing derivatives. Again no integrations are needed. 

In Section |1.4| we describe, in the framework of linear time-varying finite- 
dimensional control systems, the Hilbert Uniqueness Method, due to Jacques-Louis 
Lions. This method is quite useful in infinite dimension to find numerically optimal 
controls for linear control systems. 

Chapter [2l The subject of this chapter is the controllability of some classical 
partial differential equations. For the reader who is familiar with this subject, a 
large part of this chapter can be omitted; most of the methods detailed here are 
very well known. The linear partial differential equations which are treated are the 
following: 



1. a transport equation (Section 2.1 1 



2. a Korteweg-de Vries equation (Section 2.2) 

3. a one-dimensional wave equation (Section 



4. a heat equation (Section 2.5), 



2.4) 



5. a one-dimensional Schrodinger equation (Section 2.6 1 



6. a family of one-dimensional heat equations depending on a small parameter 



(Section 2.7 1 



For these equations, after proving the well-posedness of the Cauchy problem, we 
study their controllability by means of various methods (explicit method, extension 
method, duality between controllability and observability, observability inequalities, 
multiplier method, Carleman inequalities, moment theory, Laplace transform and 



harmonic analysis ...). We also present in Section 2.3 a classical abstract setting 
which allows us to treat the well-posedness and the controllability of many partial 
differential equations in the same framework. 



CHAPTER 1 



Finite-dimensional linear control systems 



This chapter focuses on the controllability of linear finite-dimensional control 
systems. It is organized as follows. 

- In Section 1 1.2 1 we give an integral necessary and sufficient condition (The- 
orem 1 1 . 1 1 1 on page pi) for a linear time- varying finite-dimensional control 
system to be controllable. For a special quadratic cost, it leads to the opti- 



mal control (Proposition 1.13 on pagepj). We give examples of applications. 
These examples show that the use of this necessary and sufficient condi- 
tion can lead to computations which are somewhat complicated even for 
very simple control systems. In particular, it requires integrating linear 
differential equations. In Section [l.3| we first give the famous Kalman rank 



condition (Theorem 1.16 on page KM) for the controllability of linear time- 
invariant finite-dimensional control systems. This new condition, which is 
also necessary and sufficient for controllability, is purely algebraic; it does 
not require integrations of linear differential equations. We turn then to 
the case of linear time-varying finite-dimensional control systems. For these 
systems we give a sufficient condition for controllability (Theorem 1.18 on 
page 111, which turns out to be also necessary for analytic control systems. 
This condition only requires computing derivatives. Again no integrations 
are needed. We give two proofs of Theorem |1.18| The first one is the 
classical proof. The second one is new. 
- In Section |1.4| we describe, in the framework of linear time- varying finite- 
dimensional control systems, the Hilbert Uniqueness Method (HUM), due 
to Jacques-Louis Lions. This method, which in finite dimension is strongly 
related to the integral necessary and sufficient condition of controllability 
given in Section |1.2| is quite useful in infinite dimension to find numerically 
optimal controls for linear control systems. 

1.1. Definition of controllability 

Let us start with some notations. For k € N \ {0}, R fc denotes the set of 
fc-dimensional real column vector. For k € N \ {0} and I £ N \ {0}, we denote 
by £(R fc ;R z ) the set of linear maps from R fc into R 1 . We often identify, in the 
usual way, £(R fc ;R') with the set, denoted .Mfc.z(R), of k x I matrices with real 
coefficients. We denote by M.k,i(C) the set of k X I matrices with complex co- 
efficients. Throughout this chapter, To, T\ denote two real numbers such that 
T < T u A : (T ,T X ) -> £(R n ;R n ) denotes an element of L°°((T , T x ); £(R"; R")) 
and B : (T , T t ) -» £(R m ; R n ) denotes an element of L°°((T , T t ); £{R m ; R")). We 
consider the time-varying linear control system 

(1.1) x = A{t)x + B{t)u,te[T ,T 1 ], 
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where, at time t £ [To, T{\, the state is x{t) £ R™ and the control is u(t) 6 R™, and 
x := dx/dt. 

We first define the solution of the Cauchy problem 

(1.2) x = A{t)x + B{t)u{t), x{T ) = x°, 

for given u in //((To, T{); R m ) and given a; in R". 

Definition 1.1. Let&£ L 1 ((T ,T 1 );R n ). A map a; : [T ,Ti] -» R™ is a solution 
of 

(1.3) i = i4(t)a: + 6(t) ) tG(ro,ri) I 

if a; £ C°([T , Ti]; R") and satisfies 

x{t 2 ) = x(h) + / (A(t)x(t) + b{t))dt, V(ti, ta) e [T , Ti] 2 . 

In particular, for a; £ R™, a solution to the Cauchy problem 

(1.4) x = A(t)x + b(t), t e (T , TO, x(T ) = x°, 
is a function x £ C°([T),Ti]; R ra ) such that 

a;(r) =x°+ f (A(t)x(t) + b(t))dt, Vr g [T , T x ]. 

•/To 

It is well known that, for every 6 £ L ((To, Ti); R") and for every x° £ R n , the 
Cauchy problem (1.4) has a unique solution. 



Let us now define the controllability of system (1.1). (This concept goes back 
to Rudolph Kalman [263l [264] .) 



Definition 1.2. The linear time- varying control system (1.1) is controllable 
if, for every (a; ,^ 1 ) £ R" x R", there exists u £ T°°((T , Ti); R m ) such that the 
solution x £ C°([T ,Ti];R n ) of the Cauchy problem (o]) satisfies x(Ti) = a; 1 . 

Remark 1.3. One could replace in this definition u £ L°°((T ,Ti); R m ) by 
u £ L 2 ((T , Ti); R m ) or by u £ ^((To, Ti); R m ). It follows from the proof of Theo- 
rem [lTT] on page [6] that these changes of spaces do not lead to different controllable 
systems. We have chosen to consider u £ L°°((To, Ti); R m ) since this is the natu- 
ral space for general nonlinear control system (see, in particular, Definition 3.2 on 
page 



1251. 



1.2. An integral criterion for controllability 

We are now going to give a necessary and sufficient condition for the control- 
lability of system ( 1.1 ) in terms of the resolvent of the time- varying linear system 
x = A(t)x. This condition is due to Rudolph Kalman, Yu-Chi Ho and Kumpati 
Narendra [265, Theorem 5]. Let us first recall the definition of the resolvent of the 
time-varying linear system x = A(t)x. 

Definition 1.4. The resolvent R of the time- varying linear system x = A(t)x 
is the map 

7?: [T ,Ti] 2 -4 £(R";R") 
(ti.ta) "-♦ R(h,t 2 ) 



1.2. AN INTEGRAL CRITERION FOR CONTROLLABILITY 



such that, for every t<z G [To,Ti], the map R(-,t2) '■ [Tq,Ti] 
-R(^i)^2)i is the solution of the Cauchy problem 

(1.5) M = A(t)M, M(ta) = Id„, 
where Id n denotes the identity map of K" . 

One has the following classical properties of the resolvent. 
Proposition 1.5. The resolvent R is such that 

(1.6) i?eC°([T ,T 1 ] 2 ;/:(K";R")), 

(1.7) i?(ii,ii)=Id„,ViiG [T ,Ti], 

(1.8) R{t 1: t 2 )R{t 2l t 3 ) = R(h,t 3 ), V(ti,t 2 ,*3) e [TcTx] 3 . 
In particular, 

(1.9) R(t!,t2)R(t2,tl) = Id,, V(ti,t a ) G [T ,T!] 2 . 

Moreover, £/ A G C°([T , T x ]; £(R n ; K n )) 7 tfien i? G CHPb, Ti] 2 ; £(R";R")) and 
one /ias 

<9i? 



(1.10) 
(1.11) 



<9*i 
dR 



(t, T ) = A(t)R(t,T),v(t,T) g [r ,rj' 



c*/> 



(t,T) = -iJ(t,T)A(r) 1 V(t,r)e[To ) Ti]' 



Remark 1.6. Equality (1.10) follows directly from the definition of the re- 
solvent. Equality ( jl . 1 1| ) can be obtained from (1.10 I by differentiating (1.9 I with 
respect to t%. 



Exercise 1.7. Let us define A by 

A(t) = 



t -1 
1 t 



Compute the resolvent of x = A(t)x. 

Answer. Let x\ and x 2 be the two components of x in the canonical basis of 
K 2 . Let z = xi + ix 2 G C One gets 



z = (t + i)z, 



which leads to 
(1.12) 



i z t 
z(h) = z(t 2 ) exp ( — - — + it 1 - it 2 



2 4 

2 



From (1.12), one gets 

f, 

R(h,t 2 ) = 



cos(ti -t 2 )exp ( y 



sin(ii — £2) exp 



- sin(t! — £ 2 ) exp 
COs(ii — £2) exp 



4\\ 



2jJ 



Exercise 1.8. Let A be in C 1 ([r ,Ti];£(M n ,M™)). 

1. For k G N, compute the derivative of the map 

[T ,T X ] -> £(R n ,R") 
t t-> A(t) k . 
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2. Let us assume that 

A(t)A(T) = A(r)A(t), V(i,r) e [T^T,] 2 . 
Show that 



(1.13) 



R{t 1 ,t 2 )=exp[ / A{t)dt) 7 \/{t 1 ,t 2 )e[T ,T 1 } 



3. Give an example of A such that (1.18) does not hold. 
Answer. Take n = 2 and 



A(t) :- 



t 

1 



One gets, for every (ii,i 2 ) e [T ,Xi] 2 , 



R(h,h 



1 (ti-l)e 



ti-ta 



fo + 1 



exp 



/ ti + t 2 , t f 

I J— f.f *l-*2 

2 

\0 e £ 



A(t)dt 



L (e* 



1) 



Of course, the main property of the resolvent is the fact that it gives the solution 
of the Cauchy problem (1.4). Indeed, one has the following classical proposition. 



Proposition 1.9. The solution of the Cauchy problem (1.4) satisfies 
(1.14) 

In particular. 
(1.15) 



x(h) = R(ti,t )x(t ) + I R(ti,T)b(r)dT, V(t , h) e [T , Ti]' 

to 



(t) = R(t,T )x° + [ R(t,r)b(T)dr, Vt G [Tq,^]. 

J To 



Equality (1.14) is known as Duhamel's principle. 

Let us now define the controllability Gramian of the control system x = A(t)x+ 
B{t)u. 

Definition 1.10. The controllability Gramian of the control system 

x = A(t)x + B(t)u 

is the symmetric n x n-matrix 



(1.16) 



£:= J 1 J R(T 1 ,r)B(r) J B(T) tr 7?(T 1 ,r) tr dT. 

J To 



In (1.16 I and throughout the whole book, for a matrix M or a linear map M 
from M fc into R , M tr denotes the transpose of M. 

Our first condition for the controllability of x = A{t)x + B(t)u is given in 
the following theorem [265, Theorem 5] due to Rudolph Kalman, Yu-Chi Ho and 
Kumpati Narendra. 

Theorem 1.11. The linear time varying control system x = A(t)x + B(t)u is 
controllable if and only if its controllability Gramian is invertible. 



1.2. AN INTEGRAL CRITERION FOR CONTROLLABILITY 



Remark 1.12. Note that, for every x G K n , 



€x = f X \B(T) tI R(T 1 ,T) tI x\ 2 dT. 

J To 



Hence the controllability Gramian £ is a nonnegative symmetric matrix. In partic- 
ular, £ is invertible if and only if there exists c > such that 

(1.17) x tT <£x > c\x\ 2 , \/x G R". 



Proof of Theorem 1.11 We first assume that <£ is invertible and prove that 
x = A(t)x+B(t)u is controllable. Let x° and x 1 be in R n . Let u G L°°((T , Ti); K m ) 
be defined by 

(1.18) «(r) := Blrj^fTLTJ'T 1 !! 1 - fl(Ti,r ):i: ), r G (T ,Ti). 



(In (1.181 and in the following, the notation "r G (To,Ti)" stands for "for almost 
every r G (To,Ti)" or in the distribution sense in T)'(Tq,Tx), depending on the 
context.) Let x G C ([To, Ti]; K") be the solution of the Cauchy problem 

(1.19) x = A(t)x + B(t)u{t), x(T ) = x°. 



Then, by Proposition |1.9| 
S(Ti) = R(T u T )x 



+ J^ i?(T 1 ,T)S(r)B(r) tr i?(T 1 ,T) tr e:- 1 (a ; 1 - R(T u T G )x°)dT 
R{tIt )x° + x 1 - R(T u Tv)x° 



Hence x = A(t)x + B(t)u is controllable. 

Let us now assume that € is not invertible. Then there exists y G R n \ {0} such 
that <Ly = 0. In particular, y tr Cy = 0, that is, 

(1.20) f ' y u R{T x ,T)B{T)B{TY T R{T x ,T) u ydT = 0. 



But the left hand side of (1.201 is equal to 



\B(TrR(T U TTy\ 2 dT. 



Hence (1.20) implies that 
(1.21) 



y tr i?(T 1 ,r)B(r) = 0,TG(T o ,T 1 ). 

Now let u G L 1 ((T , Ti); K m ) and x G C°([T , Tj]; R") be the solution of the Cauchy 
problem 

x = A(t)x + B(i)u(t), x(T Q ) = 0. 
Then, by Proposition |1 ,9| on the previous page, 

X(T 1 )= J ' R(T U T)B(T) U (T)dT. 
J To 



In particular, by (1.21 1, 

(1.22) 



I/ tr a;(Ti) = 0. 



Since y G 1" \ { 0}, th ere exists x 1 G 1" such that y^a; 1 7^ (for example 



.1 ._ 



y)- 



It follows from (1.221 that, whatever u is, x(Ti) 7^ x . This concludes the proof of 
Theorem 11.111 ■ 
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Let us point out that the control u defined by (1.18 I has the quite interesting 



property given in the following proposition, also due to Rudolph Kalman, Yu-Chi 
Ho and Kumpati Narendra 265, Theorem 8]. 

PROPOSITION 1.13. Let (x ^ 1 ) G K" x K n and let u G L 2 ((T , T t ); R m ) be 
such that the solution of the Cauchy problem 

(1.23) x = A(t)x + B(t)u, x(T ) = x°, 

satisfies 

x(Ti) =x\ 
Then 



2 Jj. s" I I..WI2, 



\u{t)\ 2 dt<. / \u{t)\ z dt 

with equality (if and) only if 

u(t) = u(t) for almost every t G (Tq,Ti). 

Proof of Propositi on |1.13[ Let v := u — u. Then, x and x being the solutions 
of the Cauchy problems (1.19) and (1.231, respectively, one has 



J^ R(T u t)B(t)v(t)dt = J^ R(T L ,t)B(t)u(t)dt - f£ R(Ti_,t)B(t)u{t)dt 
= (xln) - R(T L ,T )x(T )) 

-(xiTJ-RiT^ToMTo)). 

Hence 

(1.24) / R{T 1: t)B{t)v{t)dt = (x 1 - R(Ti,T )x°) - (x 1 - R{T 1 ,T Q )x°) = 

J To 



One has 



To 



To 



Ti 



To 



Ti 



(1.25) / X \u{ T )\ 2 dT= f ' \u{T)\ 2 dT+ I \v{T)\' Z dT + 2 I U tT {T)v{T)dT. 



From (1.181 (note also that £ tr = £), 



1 M tr (r)w(r)dr=(a: 1 -i?(T 1 ,T )a; ) tr G:" 1 f * R{T x ,T)B( T )v(T)dT, 

To Jt„ 



which, together with (1.24 I, gives 

(1.26) / u tr {T)v{T)dT = 0. 



Proposition 1.13 then follows from (1.251 and (1.261 



Exercise 1.14. Let us consider the control system 
(1.27) x\ = u, x<x = x\ + tu, 

where the control is u G K and the state is x := {xi,X2) tr G K 2 . Let T > 0. We 



take Tq := and T\ := T . Compute €. Check that the control system (1.21) is not 
controllable. 

Answer. One finds 

T T 2N 



rp3 



which is a matrix of rank 1. 
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Exercise 1.15. Let us consider the control system 

(1.28) x\ = x 2 , ± 2 = u, 

where the control is u 6 M and the state is x := (x\,x<2) tr G K 2 . Let T > 0. 
Compute the u G L 2 (0,T) which minimizes J Q \u{T)\ 2 dr under the constraint that 
the solution x of {1.2^ such that x{0) = (-1,0)"" satisfies x(T) = (0,0)"" 

T,x° 



Answer. Let T = 0, T x -- 
R(T u t) 




(-1,0)"" andx 1 
T-t 



(0,0) "". One gets 



12 
T3 



VrGfTcTx], 
1 



T 
2 



_T 

2 



which lead to 
12 
T3 



u(t) 



x 2 {t) 



12 
T3 



xi(t) 



12 



1.3. Kalman's type conditions for controllability 



The necessary and sufficient condition for controllability given in Theorem 1 1 . 1 1 1 
on page ^requires computing the matrix £, which might be quite difficult (and even 
impossible) in many cases, even for simple linear control systems. In this section 
we give a new criterion for controllability which is much simpler to check. 

For simplicity, we start with the case of a time invariant system, that is, the case 
where A(t) and Bit) do not depend on time. Note that a priori the controllability 
of x = Ax + Bu could depend on To and T\ (more precisely, it could depend on 
T\ — To). (This is indeed the case for some important linear partial differential 
control systems; see for example Section 2.1.2 and Section 2.4.2 below.) So we 



shall speak about the controllability of the time invariant linear control system 
x = Ax + Bu on [To, T{\. 

The famous Kalman rank condition for controllability is given in the following 
theorem. 

Theorem 1.16. The time invariant linear control system x = Ax + Bu is 
controllable on [T),Ti] if and only if 

(1.29) Span {A l Bu; «ei m ,ie{0,...,n-l}} = i". 

Ln particular, whatever Tq < T\ and To < T\ are, the time invariant linear control 
system x = Ax + Bu is controllable on [To,Ti] if and only if it is controllable on 
[To, T!] . 



Remark 1.17. Theorem 1.16 is Theorem 10 of |265| . a joint paper by Rudolph 
Kalman, Yu-Chi Ho and Kumpati Narendra. The authors of [265j say on page 201 
of their paper that Theorem |1.16| is the "simplest and best known" criterion for 
controllability. As they mention in [265, Section 11], Theorem 1.16 has previously 
appeared in the paper [29_6j by Joseph LaSalle. By [2961 Theorem 6 and page 15] 
one has that the rank condition ( 1.29 I implies that the time invariant linear control 
system x = Ax + Bu is controllable on [T , TJ; moreover, it follows from [296, page 
15] that, if the rank condition (1.291 is not satisfied, then there exists n € M n such 
that, for every u E T°°((T , Ti); R m ), 

(x = Ax + Bu(t), x(T ) = 0) => (7/ tr x(Ti) = 0) 
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and therefore the control system x = Ax + Bu is not controllable on [To,Xi]. The 
paper [265] also refers, in its Section 11, to the paper [389] by Lev Pontryagin, 



where a condition related to condition (1.29) appears, but without any connection 



stated to the controllability of the control system x = Ax + Bu. 

Proof of Theorem |1.16[ Since A does not depend on time, one has 



R{t u t 2 ) 



(t 1 -t 2 )A 



^(h,t 2 ) E [T ,T x f 



Hence 
(1.30) 



3{ T 1 -r)A BB tr e (T 1 -r)A^ d ^ 



Let us first assume that the time invariant linear control system x = Ax + Bu is 
not controllable on [To, T\\. Then, by Theorem 1 1 . 1 1 1 on pagep] the linear map £ is 
not invertible. Hence there exists y £ R™ \ {0} such that 

(1.31) £y = 0, 
which implies that 

(1.32) y tI £y = 0- 



From (1.301 and (1.321, one gets 

r-Ti 



\B tr e^ 



r)At 'y\ 2 dr 



from which we get 

(1.33) 

with 

(1.34) 



fc(r)=0,VTe[T O) r 1 ], 



k(r) := y tr e^~^ A B,\/r e [To^T,]. 
Differentiating i-times (1.34) with respect to r, one easily gets 

fcW(T x ) = {-iy y tr A l B, 



(1.35) 

which, together with (1.331 gives 

(1.36) y tr A l B = 0, V« e N. 
In particular, 

(1.37) y tr A t B = 0,Vi£{0,...,n 



!}• 



But, since y ^ 0, (1.37l implies that (1.291 does not hold 



In order to prove the converse it suffices to check that, for every y € 

(1.38) ( fl~37) => ( fl~36| , 

(1.39) (fc W ( T i) = 0, Vi e N) => (k = on [T ,Ti]), 
(1.40) 



(1.321 => (1.311 



Implication (1.381 follows from the Cayley-Hamilton theorem. Indeed, let Pa be 



the characteristic polynomial of the matrix A 

Pa(z) := det (zld„ - A) = z n - a n z n ~ x - a n ^iz n ~ 2 ... - a 2 z - a 1 . 
Then the Cayley-Hamilton theorem states that Pa{A) = 0, that is, 



(1.41) 



A n = a n A 



n-l 



u n -\A 



n-1 



a 2 A + aildr 
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In particular, 



{1.37)^y"A n B = 0. 



Then a straightforward induction argument using (1.41 1 gives (1.38). Implication 
(1.391 follows from the fact that the map k : [Tq,Ti] — » A^i, m (l) is analytic. 



Finally, in order to get (1.40), it suffices to use the Cauchy-Schwarz inequality for 
the semi-definite positive bilinear form q(a, b) = a tr Cb, that is, 

\y^€z\ < {jftyff^tzf 2 . 
This concludes the proof of Theorem |1.16| ■ 



Let us now turn to the case of time- varying linear control systems. We assume 
that A and B are of class C°° on [T , T\] . Let us define, by induction on i a sequence 
of maps B t £ C°°{[T , T ± ]; £(R m ; R")) in the following way: 

(1.42) B (t) := B(t), Bi(t) := B«-i(t) - A(t)B^ x (t), V* € po,^]. 

Then one has the following theorem (see, in particular, the papers [86] by A. Chang 



and [447 by Leonard Silverman and Henry Meadows). 
Theorem 1.18. Assume that, for some i £ [T ,Ti], 
(1.43) Span {Bi{t)u; u € R™ ieN} = R". 

Then the linear control system x = A(t)x + B(t)u is controllable (on \Tq,T{\). 



Before giving two different proofs of Theorem |1.18| let us make two simple 
remarks. Our first remark is that the Cay ley-Hamilton theorem (see ( 1.41 )) can no 



longer be used: there are control systems x = A(t)x + B(t)u and t G [Tq,Ti] such 

that 

(1.44) 

Span {Bi(i)u; u £ R m , ieM}/ Span {B t {t)u; u £ R m , i£{0,...,n- 1}}. 

For example, let us take To = 0, T\ = 1, n = m = 1, A(t) = 0, Bit) = t. Then 

B (t) = t 1 B 1 {t) = l,Bi(t) = 0, V* £N\{0, 1}. 



Therefore, if t = 0, the left hand side of ( 1.44 I is R and the right hand side of ( 1.44 ) 
is{0}. 

However, one has the following proposition, which, as far as we know, is new and 
that we shall prove later on (see pages 15 19 see also [448j by Leonard Silverman 



and Henry Meadows for prior related results). 

PROPOSITION 1.19. Lett £ [T ,Ti] be such that (1.4ty holds. Then there exists 
e > such that, for every t £ ([T ,Ti] D (i- e,i+e)) \ {t}, 

(1.45) Span {Bt(t)u; u £ R m , »6{0,...,n-l}} = R". 

Our second remark is that the sufficient condition for controllability given in 

1, or A and B are assumed 
2, m 



19). Indeed, let us take n 



Theorem 1.18 is not a necessary condition (unless n 

to be analytic; see Exercise 1.23 on page 

A = 0. Let / £ C°°([T ,Ti]) and g £ C°°([To,T t ]) be such that 

(1.46) / = on [(T + T 1 )/2 7 T 1 ] 7 g = on [T , (T + TO/2], 

(1-47) /(T ) + 0, g{T x ) + 0. 



1, 
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Let B be defined by 

(1.48) 

Then 



B(t) :- 



fit) 

git) 



,we[To,:ri]. 



7£ fit) 2 dt 



Srlaitfdtj 



Hence, by (1.47l, £ is invertible. Therefore, by Theorem 1 1 . 1 1 1 on pagepl the linear 
control system x = A(t)x + B(t)u is controllable (on [7o,Ti]). Moreover, one has 

Bi(t) = (£(!)[$) > v * e [To.Ti], V* g N. 



Hence, by (1.46), 



Span {Bi(t)u; ii6R,i£N}c {(a, 0) tr ; a G R}, V< G [T , (T + 2i)/2], 
Span {Bi(i)u; u G K, % G N} C {(0,a) tr ; a G E}, Vi G [(T + T 1 )/2,T 1 ]. 



Therefore, for every t G [Xb,Ti], (1.431 does not hold. 

Exercise 1.20. Prove that there exist f G C ,oo ([T ,T 1 ]) and g G C°°([ro,Ti]) 
smc/i that 

(1.49) Support f fl Support g = {Tq}. 

Let us fix such f and g. Let B G C°°{[T 0l 7\]; K 2 ) be defined by fTjfljf . We take 
n = 2, m = 1, A = 0. Prove that: 

1. For every T G (T ,Ti), the control system x = B(t)u is controllable on 
[T ,T]. 

2. For every t G [Tb,Ti], (1.43) does not hold. 

Let us now give a first proof of Theorem |1.18[ We assume that the linear 
control system x = A(t)x + B(t)u is not controllable. Then, by Theorem 1 1 . 1 1 1 on 
pagepl €. is not invertible. Therefore, there exists y G 1" \ {0} such that £y = 0. 
Hence 

Q = y t ^y= f 1 \B(r)^R(T 1 ,r) tI y\ 2 dr = 0, 

J T 



K(t) := z tx R{t,T)B{r) = 0, Vr G [To.rj, 



which implies, using (1.8 1, that 

(1.50) 

with 

z:=R{T u tfy. 

Note that, by (1.9), R(Ti,t) tr is invertible (its inverse is R(t, 2~i) tr ). Hence z, as y, 
is not 0. Using (1.11 1, (1.42) and an induction argument on i, one gets 

(1.51) A-W(t) = z tr i?(t,T)B J (r),VT G [To.Ti], V* G N. 



By (1.7), (1.501 and (1.51), 



z tr Bi(t) = 0, Mi G N. 



As z / 0, this shows that (1.431 does not hold. This concludes our first proof of 
Theorem fl~T8l ■ 
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Our second proof, which is new, is more delicate but may have applications for 
some controllability issues for infinite-dimensional control systems. Let p G N be 
such that 

Span {Bi(t)u; u G R m , i € {0, . . . ,p}} = R n . 
By continuity there exists e > such that, with [to, £i] := Pb, T±] n [i — e, t + s], 

(1.52) Span {B^tju; u G R m , i G {0,...,p}} = R", Vie [t , h]. 

Let us first point out that 
p 

(1.53) ^ B L {t)B t {t) tr is invertible for every t G [*o,*l]- 

4 = 

Indeed, if this is not the case, there exist t* G [to^i] an d 

(1.54) 

such that 



a G R" \ {0} 
J2B l (t*)B l (t*) tI a = 0- 



i=0 



In particular, 

which implies that 
(1.55) 



Y j a tI B l (t*)B l (t*) t *a=0, 
B l (t*) tr a = 1 V*G {0,...,p}. 



From (1.551, we get that 

/ p \ tr 

J2 Bi(t*)vi ) a = 0, V(ia,, . • . , v P ) G (l m )' +1 , 



vi=0 



which is in contradiction with (1.52) and (1.54). Hence (1.53) holds, which allows 
us to define, for j G {0,.,.,p}, Q, G C°°([t , h]; £(R"; R m )) by 

p 
Q,(t) := B i (t) to (^B i (t)Bi(t) tr )- 1 , Vt G [io.ii]. 



We then have 
(1.56) 



^S l (i)Q l (i)=Id n ,ViG [t , ill- 



Let {x°,x l ) G R™ x R™. Let 7 G C°°([T , Ti];R") be the solution of the Cauchy 
problem 

(1.57) 7° = A(t) 7 °, 7 °(T ) = x°. 

Similarly, let 7 1 G C°°([T , 7\]; R") be the solution of the Cauchy problem 

(1.58) ^ = A(t) 1 \ 1 1 (T 1 ) = x 1 . 
Let d G C°°([T ,Ti]) be such that 

(1.59) d = 1 on a neighborhood of [7b, £0] m [7b, 7\], 

(1.60) d = on a neighborhood of [£i,Ti] in [7b, 7\]. 



14 



1. FINITE-DIMENSIONAL LINEAR CONTROL SYSTEMS 



Let T G C^QTcTi^R") be defined by 

(1.61) T(t) := d(t)7°(*) + (1 " ^))7 1 W, Vt G [Tq,^]. 



From fll.57| , (|l_58j), fll.59| , |L60j) and fll.61| , one has 

(i.62) r(T ) = x°, r(r x ) = x 1 . 

Let g G C oo ([T ,T 1 ];K n ) be defined by 

(1.63) g(t) := -f (*) + A(t)T(t), Vt G [T ,Ti]. 



It readily follows from ( |1.57| , fll.58| , (|l_59j) and (|l_60j) that 

(1.64) q = on a neighborhood of [T ,t ] U [ii,^] in [Tq,^]. 

Let us now define a sequence (wi)ie{o....,p-i} of elements of C°°([£o>£i]; 
requiring (decreasing induction on i) that 

(1.65) «p-i(t) := Q P (t)q{t), Vt G [to, *i], 

(1.66) m_!(t) := -«<(«) + Qi{t)q{t), V* G {1, . . . ,p - 1}, V* G [* , *i] 



l ) by 



Finally, we define w : [Tq,Ti] 



r: [T ,T 1 ]^R"and^: [T ,Ti] 



by 



(1.67) u:=0on [T 0l t ] U [ti.TJ and u(t) := u (t) - Qo(t)q(t), Vt G (* ,*i), 

p-i 

(1.68) r:=0on [T , t ] U [*i,Ti] and r(t) := ^ B t (t) Ul (t), Vi G (* ,*i), 



i=0 



(1.69) 



arW^rW + rW.VtGlTo.Ti]. 



It readily follows from (1.64 1, (1.65), (|1.66| , (1.67l and (1.68) that u, r and x are 
of class C°°. From ( |1.62[ ), fll.68| and ( 1.69[ ), one has 

(1.70) z(T ) = x°, x(Ti) = aj 1 . 
Let 9 G C°°([T , Ti]; 1") be defined by 

(1.71) 9{t) :=x(t)-(A(t)x(t) + B(t)u(t)),Vte [T ,Ti]. 



From ( |1.63| , (JL64J), (|1_67|, (|l.68|), (|l.69| and (|l.7l|), one has 

(1.72) 



Let us check that 
(1.73) 



6 = on [To.tolUfa.Tx] 



on (*o,*l)- 



From (1.631, (1.68), (1.691 and (1.71), one has on (t ,ti), 



r + r - A(T + r) - Bu 
( p - 1 . \ 

-g+ 1 y, Biu t J 



p-i \ /p-i \ 

^ B^ I - I Y^ AB lUl I - Bu, 

i=0 ) \j=0 / 
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which, together with (1.421, (1.651, (1.66) and (1.67), leads to 



/p-i \ /p-i \ 

-q + ^2(B, l+1 + ABi) Ui + {J2 Bi(-Ui-i + Qil) 

\i=0 ) \i=\ / 



(1.74) 



Bii Q 



fp-X 



-q + B p u p ^i + \y^B 

P 
-q + y^^BjQiq. 




Bu 



B{u + Q q) - Bu 



From ( 1.56[) and (|1.74[), one has (1.73). Finally, our second proof of Theorem 1.18 



on page 



11 follows from (1.70), (1.71 1, (1.721 and (1.731 



Remark 1.21. The above proof is related to the following property: A generic 
under-determined linear differential operator L has a right inverse M (i.e., an op- 
erator M satisfying (L o M)q = q, for every q) which is also a linear differential 
operator. This general result is due to Mikhael Gromov; see [2061 (B), pages 150- 
151] for ordinary differential equations and [2061 Theorem, page 156] for general 
differential equations. Here we consider the following differential operator: 

L(x,u) :=x- A(t)x - B(t)u, Vx e C°°([to,ti]',R n ), Vu e C°°([i ,ii];R m ). 
Even though the linear differential operator L is given and not generic, Property 



(1.52 I implies the existence of such a right inverse M, which is in fact defined above: 

M(q) :-- 



It suffices to take 



with 



(x,u), 



p-i 
x(t) :=^Bi(t)xH(t),Wt€ [to,h], 

i=0 

u(t) := «o(t) - Q (t)q(t), Vi e [to,*i] 



where (t^ )ig.fo, .„ 1 p-i) is the sequence of functions in C°°([to, t\]', 1 
requiring (1.65) and (1.66). 



l ) defined by 



Proof of Proposition 1.19 on page 11, Our proof is divided into three 
steps. In Step 1, we explain why we may assume that A = 0. In Step 2, we take 
care of the case of a scalar control (m = 1). Finally in Step 3, we reduce the 
multi- input case (m > 1) to the case of a scalar control. 

Step 1. Let R E C°°([T ,Ti] x [T ,Ti];£(M n ;K")) be the resolvent of the time- 
varying linear system x = A(t)x (See Definition 1.4 on page HI). Let 

SeC oo ([T ,T 1 ];/:(K m ;K")) 

be defined by 

B{t)=R{i,t)B{t),\/te [T ,2i]. 
Let us define, by induction on i e N, B t G C°°([To,Ti]; £(M m ;M™)) by 



B = B and B t = B t _ u Mi e N \ {0}. 



l(i 



1. FINITE-DIMENSIONAL LINEAR CONTROL SYSTEMS 



In other words 

(1.75) B t = B^. 

Using ( |1.11[ ), one readily gets, by induction on i G N, 

Bi(t) = R(t,t)Bi(t), Vt G [Tq,^], V« € N. 



In particular, since R(t,t) = Id„ (see (1.7|) and R(t,t) is invertible for every t G 
[T ,Ti] (seeQ), 

Span {-Bj(i)«; u G K"\ i G N} = Span {!?,(£)«; u G R m , i G N}, 

dim Span {Bi(t)w, uG R m , i G {0, . . . ,n - 1}} 

= dim Span {JBj(t)u; uG M m , i€ {0,...,n- 1}}, Vi G [T ,?l]. 



Hence, replacing B by B and using (1.75), it suffices to consider the case where 
(1.76) A = 0. 



In the following two steps we assume that (1.761 holds. In particular, 

(1.77) B l = B {i \ ViGN. 

Step 2. In this step, we treat the case of a scalar control; we assume that m = 1. 
Let us assume, for the moment, that the following lemma holds. 

Lemma 1.22. Let B G C°°([T ,Ti];R n ) and i G [T ,Ti] be such that 

(1.78) Span {B {l \i); ieN} = R". 

Then there exist n integers pi G N, i G {1, . . . ,n} ; n functions a, G C°°([To,Xi]), 
i G {1, . . . , n}, n vectors fi G K", i G {1, . . . , n}, suc/i i/iai 

(1.79) Pi < m i,ViG{l,...,n-l}, 

(1.80) Oi(t)^o,Vi €{!,... ,n}, 



(1.81) 

(1.82) 



B(t) = J2a i (t)(t-t) Pi f i ,Vte[T ,T 1 ], 
Sjpan {/(;*€{!,..., n}} = R B . 



From (1.77 1 and (1.81), one gets that, as t — > i, 

(1.83) det (B (i),Si(i),...,S„-i(i))=X(t-i)- ( " (ri - 1)/2)+ ^- Pl 

+ ((£- i) 1 -("(™- 1 )/ 2 )+^i=iP' 
for the constant _ft" defined by 

(1.84) X :=if(p 1 ,...,p n ,oi(t),...,o„(t),/i,...,/ m ). 
Let us compute K. Let B G C7°°(R; 1") be defined by 



(1.85) 



B(t) = J2^(t)t p <f l ,Vt£ 



One has 

(1.86) det {B^\t),B {1 \t),...,B { - n - 1 \t)) = Kt~^ n '^/^+^=^\ Vi G 
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But, as one easily sees, for fixed t, fixed real numbers Oj(i) and fixed integers pi 
satisfying (1.791, the map 

(/i,...,/„) eM" x . . . x M n h-» det (.B (0) (i),5 (1) (£),..., -B ( " _1) (f)) eR 

is multilinear and vanishes if the vectors /i,...,/ n are dependent. Therefore X 
can be written in the following way: 



(1.87) 



K := F( Pl , ... Pn )(ll Oi(*) det (A, ...,/„ 



Taking for (/i, ...,/„) the canonical basis of K™ and ai(t) = 1 for every i € 
{1, . . . ,n}, one gets 

(1.88) det (B(°>(t),B( 1 )(f),...,B( n - 1 >(()) = i -("(n-i)/2)+E?= 1 Pidet M, 

with 



M 



^1 pi pi(pi-l) ... pi(pi-l)(pi-2)...(pi-n + l)^ 

1 J>2 P2(P2 - 1) • • ■ P2&2 ~ 1)(P2 - 2) . . . (p 2 - n + 1) 



\1 Pn Pn(Pn-l) ••■ Pn (Pn ~ 1) (Pn ~ 2) . . . (p n - 12 + I) J 

The determinant of M can be computed thanks to the Vandermonde determinant. 
One has 

„n-l\ 



(1.89) 



det M = det 



/l Pl p\ ... p\- X \ 
1 p 2 p\ ... J,™" 1 



\1 Pn Pr, 



prv 



n fa-Pi)- 



Hence, from (|1.87|, (|1.88|) and (|1.89|, we have 
(1.90) 



K 



II (Pi-W)) (na J (i))det(/ 1 ,...,/„). 



From ( |1.79| , ( |l.80[ ), ( |l.82| , and ( |l.90| , it follows that 
(1.91) K^O. 



From (1.83) and (1.91), one gets the existence of e > such that, for every t € 
([10,71] n(f-e,F+e))\{i}, ( 
Let us now prove Lemma 



1.451 holds. 

by induction on n. This lemma clearly holds 
if n = 1. Let us assume that it holds for every integer less than or equal to 
(n — 1) € N \ {0}. We want to prove that it holds for n. Let p\ € N be such that 

B W (i) = 0, V«eNn[0,pi-l], 
£(Pi)(i)/0. 



(1.92) 
(1.93) 



(Property (1.781 implies the existence of such api.) Let 
(1.94) h:=B^\i). 



By (1.931 and (1.94 1, 



/iT^O. 
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Let E be the orthogonal complement of f\ in R n : 

(1.95) E := /^-R"- 1 . 

Let n B : R" -> E be the orthogonal projection on E. Let C G C^QTo.Ti]; E) be 
defined by 

(i.96) cw^nuflW.vtepb.Ti]. 

From (1.781 and (1.961, one gets that 

(1.97) Span {C (l) (*>; u G R m , ieN} = E. 

Hence, by the induction assumption, there are (n— 1) integers pi G N, i G {2, . . . , n}, 
(n — 1) functions a,i G C°°([To,Ti]), i € {2, ...,n}, (n — 1) vectors fi £ E, i E 
{2, . . . ,n}, such that 

(1.98) Pi <p i+ i,Vie{2,...,n-l}, 

(1.99) o i (t)^0,Vie{2,...,n}, 



(1.100) 
(1.101) 



C(t)= £o« (*)(*- *)"/», Vt€ [T 0> Ti], 



/ = 2 



Span {/*; »e{2,...,n}} = £. 



Let g G C°°([ro,Ti]) be such that (see fll.95| , (JL96J) and ( |1.100| ) 
(1.102) B(t) = S (t)/i + J2 °*(*)(* " *)"/*» V * G I T °' T il- 



Using (L92) , ( |L93| , | |L94| ), ( [195) , ( |L99| ), ( pLIOl) and ( [L102| , one gets 

pi <pi, Vi G {2, ...,n}, 

3a x € C^ClTo.Tx]) such that oi(t) + and #(*) = (t - t) Pl ai(t) , Vi € [T 0) Ti]. 

This concludes the proof of Lemma |l ,22| and the proof of Prop osition | 1 . 1 9"] on page 11 

for m = 1. 

Step 3. Here we still assume that ( 1.76 1 holds. We explain how to reduce the case 

rn > 1 to the case m = 1. Let, for i G {1,... ,m}, 6 l G C ,oo ([T ,Ti];R n ) be such 

that 

(1.103) B(t) = (h(t), . . . , 6 m (t)), Vi G [T ,T X ]. 
We define, for i G {1, . . . , m}, a linear subspace E^ of R n by 

(1.104) £;:=Span {&jj°(t); fc G {!,...,*}, j G n} . 



From fll.43| , (JL77J), ( |1.103| and ( |1.104| , we have 

(1.105) £ m = R". 

Let gGN\ {0} be such that, for every i G {1, . . . , m}, 

(1.106) £j = Span {&£°(t); fc G {1,...,*}, j € {0, ... ,g- 1}} 

Let 6 G C°°([T , T x ]; R") be defined by 



(1.107) 



b(t) -J^it-i^^UVytelTo,^}. 



i = l 
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From ( 1.106 I and ( 1.1071, one readily gets, by induction on i G {1, . . . , to}, 
£ i = Span {b®®;j€{0,...iq-l}}. 



In particular, taking % = m and using p. 105), we get 
(1.108) 



Span {^)(i);j€N} = E". 



Hence, by Proposition 1.19 applied to the case to = 1 (i.e., Step 2), there exists 
£ > such that, for every te ([T ,Ti]n {t - e,t + e))\{i], 



(1.109) 



Span h {j) (t); i G {0, . . . , n - 1}} 



Since, by (1.107) 



Span {&«(*); j G {0, . . . , n - 1}} 

cSpan {b^{t);ie{l,...,m},je{0, 
this concludes the proof of Proposition |1.19| on page |11| 
Let us end this section with an exercise. 



,71—1 



'} 



Exercise 1.23. Let us assume that the two maps A and B are analytic and 
that the linear control system x = A(t)x + B{t)u is controllable (on [To, T\\). Prove 
that: 

1. For every t G [T ,Ti], 

Span {Bi(t)u; u G E m , i G N} = E". 

2. The set 

{te [T , Ti]; Span {Bi(t)u; u eR m , i £ {0, . . . ,n - 1}} ^ E"} 
is finite. 



1.4. The Hilbert Uniqueness Method 

In this section, our goal is to describe, in the framework of finite-dimensional 
linear control systems, a method, called the Hilbert Uniqueness Method (HUM), 
introduced by Jacques-Louis Lions in J325L I326J to solve controllability problems 
for linear partial differential equations. This method is closely related to duality be- 
tween controllability and observability. This duality is classical in finite dimension. 
For infinite-dimensional control systems, this duality has been proved by Szymon 
Dolecki and David Russell in |146j . (See the paper [2 93] by John Lagnese and the 
paper 48J by Alain Bensoussan for a detailed description of the HUM together with 
its connection to prior works.) The HUM is also closely related to Theorem |l.ll| on 
page [6] and Proposition 1.13| on page [8] In fact it provides a method to compute the 
control u defined by (1.181 for quite general control systems in infinite dimension. 



We consider again the time- varying linear control system 

(1.110) x = A(t)x + B{t)u,te[T ,T 1 ], 

where, at time t e [T , Ti], the state is x(t) e E™ and the control is u(t) G E m . Let 
us also recall that A G L°°((T ,Ti); £(M n ;K n )) and B G L°°((T Q , Ti); £(E m ;E")). 
We are interested in the set of states which can be reached from during the time 
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interval [To,Ti]. More precisely, let 1Z be the set of x 1 G R™ such that there exists 
u G L 2 ((Tq, T\); R m ) such that the solution of the Cauchy problem 

(1.111) x = A(t)x + B(t)u(t), x{T ) = 0, 

satisfies x{T x ) = x . For (j) 1 given in R n , we consider the solution <fi : [T , Ti] — > R™ 
of the following backward Cauchy linear problem: 

(1.112) 4> = -Ait)'^, cf>(T x ) = 4>\te [r 0> Ti]. 



This linear system is called the adjoint system of the control system (1.110 I. This 
terminology is justified by the following proposition. 

PROPOSITION 1.24. Let u G L 2 ((r ,Ti);R m ). Let x : [T ,Ti] -> W 1 be the 



the solution of the Cauchy problem (1.112). Then 



solution of the Cauchy problem (1.111). Let (ft 1 G R n and let </> : [T ,Xi] — > R™ be 



(1.113) x(T x ) ■(/)= u(t) ■ B(t) tr (j)(t)dt. 

J To 






In (1.1131 and throughout the whole book, for a and b in R , ( £ N\ {0}, a ■ b 
denotes the usual scalar product of a and b. In other words a ■ b := a tr 6. 
Proof of Proposition |1.24[ We have 

x{T x )-^ = J X ±(x(t) ■ 4>(t))dt 

((A(t)x(t) + B(t)u(t)) ■ (t>(t) - x(t) ■ A{t) tT ij>(t))dt 

T 
Ti 

u{t) ■ B(t) tr (j)(t)dt. 

To 



This concludes the proof of Proposition |1.24| 

Let us now denote by A the following map 

R" -> R" 
^ >-> »(Ti) 

where a; : [T , T\] — > R" is the solution of the Cauchy problem 

(1.114) x = A(t)x + B(t)u(t), x{T ) = 0, 
with 

(1.115) u(t) := B(t) tr 4>(t). 

Here <f> : [T ,Ti] — > R™ is the solution of the adjoint problem 

(1.116) 4> = -Ait)'^, cf>(T x ) = 4>\te [r 0> Ti]. 

Then the following theorem holds. 
Theorem 1.25. One has 

(1.117) TZ = A{R n ). 
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Moreover, if x 1 = A(cj ) 1 ) and if u* € L 2 ((Tq, T\)\ W n ) is a control which steers the 
control system (1.110) from to x 1 during the time interval [Tq,Ti], then 

\1j+^ \ L.*AA|2. 



(1.118) 



ltt(t)r*^ / \u*{t)\ z dt, 

To Jt 



(where u is defined by (1.115)-(1.116)), with equality if and only if u* = u. 



Of course Theorem |1.25| on the previous page follows from the proofs of The- 
orem 1 1 . 1 1 1 on page [6] and of Proposition 1 1 . 1 3| on page [8J but we provide a new 
(slightly different) proof, which is more suitable to treat the case of linear control 
systems in infinite dimension. 

By the definition of A, 

(1.119) A(K") C n. 

Let x 1 be in 1Z. Let u* € L 2 ((Tq 7 T\); M. m ) be such that the solution x* of the 
Cauchy problem 

x* = A(t)x* + B{t)u*{t), x*{T ) = 0, 

satisfies 



(1.120) 

LetWc L 2 ((T ,Ti);l 
where <f> : [To,Xi] 



a;*(T 1 ) = a; 1 . 

be the set of maps of the form t € [Tq,Ti] i— > B (t) <ft(t) 
-> R n satisfies ( |1.112[ ) for some c/) 1 e R™. This set U is a 
vector subspace of L 2 ((To,Ti);R m ). By its definition, U is of finite dimension (its 
dimension is less than or equal to n). Hence IA is a closed vector subspace of 
L 2 ((To,Ti);M m ). Let u be the orthogonal projection of u* on U. One has 

(1.121) / u*(t)-u(t)=l u(t)-u(t)dt,VueU. 

Let x : [T ,Ti] - 
(1.122) 



To J T 

be the solution of the Cauchy problem 
x = A(t)x + B(t)u(t), x{T Q ) = 0. 



From Proposition 



1.24 



(1.120), (1.121) and (1.1221, 



x 1 -cj) 1 =x{T 1 ) -^^(f) 1 eB", 
which implies that 

(1.123) x 1 = x(T 1 ). 

Since u € IA, there exists (j) 1 such that the solution <f> of the Cauchy problem 

4>=-A(t) tI 4>J(T 1 ) = 4> 1 ,t€[T ,T 1 ], 

satisfies 

u (t) = B (tf4>(t),te[T ,T 1 }. 
By the definition of A and ( |1.122 ) , 

A(4> 1 ) = i(T 1 ) 1 



which, together with (1.1231, implies that x 1 = A(0 1 ) and concludes the proof of 

Finally, let x 1 = A((/> 1 ), let u be defined by ( |l.ll5| -( |L116| and let 

«*eL 2 ((T ,r 1 );K m ) 
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be a control which steers the control system (1.110) from to x 1 during the time 
interval [Tq,Ti]. Note that, by the definition of U, u g IA. Moreover, using Propo- 
sition [L24] on page |20| once more, we get that 

u*(t) ■ u(t)dt = / u(t) ■ u(t)dt, \/u g U. 
i T J T 

Hence u is the orthogonal projection of u* on hi and we have 

1 \u*{t)\ 2 dt = J 1 \u(t)\ 2 dt + J l \u*{t) - u\ 2 dt. 

'To J T[) J To 

This concludes the proof of Theorem |1.25[ ■ 



CHAPTER 2 



Linear partial differential equations 



The subject of this chapter is the controllability of some classical partial dif- 
ferential equations. For the reader who is familiar with this subject, a large part of 
this chapter can be omitted; most of the methods detailed here are very well known. 
One can find much more advanced material in some references given throughout 
this chapter. The organization of this chapter is as follows. 

- Section [2 . 1 |concerns a transport equation. We first prove the well-posedness 



of the Cauchy problem (Theorem 2.4 on page 27 1. Then we study the 



controllability by different methods, namely: 

- An explicit method: for this simple transport equation, one can give 
explicitly a control steering the control system from every given state 
to every other given state (if the time is large enough, a necessary 
condition for this equation). 

- The extension method. This method turns out to be useful for many 
hyperbolic (even nonlinear) equations. 

- The duality between controllability and observability. The idea is the 
following one. Controllability for a linear control system is equivalent 
to the surjectivity of a certain linear map T from a Hilbert space 
H 1 to another Hilbert space H 2 . The surjectivity of T is equivalent 
to the existence of c > such that 

(2.1) \\J r *(x 2 )\\H 1 >c\\x 2 \\ H2 ,Vx 2 eH 2 , 

where T* : H 2 — > Hi is the adjoint of T . So, one first computes 



T* and then proves (2.1 ). Inequality (2.1 ) is called the observability 
inequality. This method is nowadays the most popular one to prove 
the controllability of a linear control partial differential equation. 
The difficult part of this approach is to prove the observability in- 



equality (2.1 1. There are many methods to prove such an inequality. 
Here we use the multiplier method. We also present, in this chapter, 
other methods for other equations. 



Section 2.2 is devoted to a linear Korteweg-de Vries (KdV) control equation. 
We first prove the well-posedness of the Cauchy problem (Theorem 2.23 on 
page 



39). The proof relies on the classical semigroup approach. Then we 
prove a controllability result, namely Theorem |2 . 25 1 on page [42] The proof 
is based on the duality between controllability and observability. The ob- 



servability inequality (2.1 1 ((2.156 I for our KdV equation) uses a smoothing 
effect, a multiplier method and a compactness argument. 
- In Section |2.3| we present a classical general framework which includes as 
special cases the study of the previous equations and their controllability 
as well as of many other equations. 

23 
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Section [2. 4| is devoted to a time- varying linear one-dimensional wave equa- 
tion. We first prove the well-posedness of the Cauchy problem (Theo- 
rem 2.53 on page 68 1. The proof also relies on the classical semigroup 
approach. Then we prove a controllability result, namely Theorem 2.55 on 
page |72| The proof is based again on the duality between controllability 



on page 



74 



and observability. We prove the observability inequality (Proposition 2.60 
[) by means of a multiplier method (in a special case only), 
concerns a linear heat equation. Again, we first take care of the 

on page 77 1 by means 



Section |2. 5 

well-posedness of the Cauchy problem (Theorem 2.63 



of the abstract approach. Then we prove the controllability of this equation 

The proof is based on the duality between 



(Theorem 2.66 



on page 



791 



controllability and observability, but some new phenomena appear due to 
the irreversibility of the heat equation. In particular, the observability 
inequality now takes a new form, namely (2.398). This new inequality 
is proved by establishing a global Carleman inequality. We also give in 
this section a method, based on the flatness approach, to solve a motion 
planning problem for a one-dimensional heat equation. Finally we prove 
that one cannot control a heat equation in dimension larger than one by 
means of a finite number of controls. To prove this result, we use a Laplace 
transform together with a classical restriction theorem on the zeroes of an 
entire function of exponential type. 

Section [2. 6| is devoted to the study of a one-dimensional linear Schrodinger 
equation. For this equation, the controllability result (Theorem 2.87 on 
page 96 I is obtained by the moments theory method, a method which is 



quite useful for linear control systems with a finite number of controls. 
- In Section 2.7 we consider a singular optimal control. We have a family 



of linear control one-dimensional heat equations depending on a parameter 
e > 0. As e — y 0, the heat equations degenerate into a transport equation. 
The heat equation is controllable for every time, but the transport equation 
is controllable only for large time. Depending on the time of controllability, 
we study the behavior of the optimal controls as e — > 0. The lower bounds 
on page 



(Theorem 2.95 



104 1 are obtained by means of a Laplace transform 



together with a classical representation of entire functions of exponential 
type in C+. The upper bounds (Theorem 2.96) are obtained by means 



of an observability inequality proved with the help of global Carleman 

inequalities. 

Finally in Section |2.8| we give some bibliographical complements on the 

subject of the controllability of infinite-dimensional linear control systems. 



2.1. Transport equation 

Let T > and L > 0. We consider the linear control system 

(2.2) y t + y x = 0,t€(0,T),xe(0 > L), 

(2.3) y(t,0)=u(t), 

where, at time t, the control is u(t) G K and the state is y(t, •) : (0, L) — » K. Our 
goal is to study the controllability of the control system (2.2 l-(2.3l; but let us first 



study the Cauchy problem associated to (2.2l-(2.3l 



2.1. TRANSPORT EQUATION 



2 r > 



2.1.1. Well-posedness of the Cauchy problem. Let us first recall the 
usual definition of solutions of the Cauchy problem 



(2.4) 
(2.5) 
(2.6) 



yt + y x =0,t£(0,T) 7 xe (0,L), 

y(t,0)=u(t),te(0,T), 

y(0,x)=y°(x),xe(0,L), 



where T > 0, y° G L 2 (0,L) and u G L 2 (0,T) are given. In order to motivate 
this definition, let us first assume that there exists a function y of class C 1 on 



[0,2*] x [0,L] satisfying (2.4 1-(2.5 )-(2.6 ) in the usual sense. Let r e [0,T]. Let 



</> G C 1 ([0,r] x [0,L]). We multiply (2.4) by <f> and integrate the obtained identity 



on [0,t] x [0,L]. Using (2.5|, (2.6) and integrations by parts, one gets 



{4>t + (f>x)ydxdt + / y(t,L)(f>(t,L)dt- / u{t)<f){t,0)dt 
i) ./ii Jo Jo 

Z, ,-L 

y(T,x)<fi(T,x)dx — / y°(x)<f>(0,x)dx = 0. 
o Jo 

This equality leads to the following definition. 

Definition 2.1. Let T > 0, y° e L 2 (0 L) and u G L 2 (0,T) be given. A soZu 



tion of the Cauchy problem (^4>- |g.5| )- |g.g| ) is a function 2/ G C°([0,T]; L 2 (0, L)) 
such that, for every r G [0, T 



(2.7) 
one has 

(2.8) - 



and for every (/> G C 1 ([0, r] x [0, L]) such that 
<t>(t, L) = 0, Vt G [0,r], 



Jo 



b x )ydxdt - 



u(£)0(£,O)d£ 

j/(t, x)4>{t, x)dx — I y (x)<f>(0,x)dx = 0. 
Jo 



This definition is also justified by the following proposition. 

Proposition 2.2. Let T > 0, y° G L 2 (0,L) and u G L 2 (0,T) be given. Let 



us assume that y is a solution of the Cauchy problem (2.4)-(2.5)-(2.6) which is of 
class C 1 in [0,T] x [0,L]. Then 



(2.9) 

(2.10) 

(2.11) 

(2.12) 

(2.13) 



y°€C l ([0,L}), 

«eC 1 ([o,r]), 

y(0,x) = y Q (x),Vx£{0,L}, 

y{t,0) = u{t),\/te [0,T], 

Vt(t,x) + y x (t,x) = 0,V(t,x)€ [0,T] x [0,L]. 



Proof of Proposition 



2.2 



Let <f> G C X {[Q,T\ x [0,L]) vanish on ({0,T} x 
[0,L]) n ([0,T] >: {0,L}). FroinDefinition [2~T| we get, taking r := T, 

cT /•£ 

{<t>t + 4> x )ydxdt = 0, 
Jo 
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which, using integrations by parts, gives 

(2.14) f f (y t + y x )(j>dxdt = 0. 

Jo Jo 

Since the set <f> G C l ([0,T] x [P L]) v anishing on ({0,T} x [0,L]) f) ([0,T] x {0,L}) 
is dense in L 1 ((0,T) x (0,L)), (|2.14| implies that 



(2.15) f f (y t + y x )<t>dxdt = 0, V</> G ^((0, T) x (0,L)). 

Taking G L 1 ^^) x (0,L)) defined by 

(2.16) <j>{t, x) := 1 if y t (t, x) + y x (t, x) > 0, 

(2.17) 4>{t, x):=-l if y t (t, x) + y x {t, x) < 0, 
one gets 



(2.18) 



T r L 



JO 



\y t + y x \dxdt = 0, 



which gives ( |2.13[ ). Now let </> G C^QO, T] x [0, L]) be such that 
(2.19) 4>{t,L) = 0,V£G [0,T]. 



From (2.8) (with r = T), (2.13), (2.191 and integrations by parts, we get 

(2.20) f (y(t,0)-u(t))<l>(t,0)dt+ [ (y(0,x)-y°(x))^(0,x)dx = 0. 
Jo Jo 

Let B : ^([0,7] x [0,L]) -* L 1 ^,? 1 ) x L^O,!,) be defined by 

B(0):=(0(-,O),0(O,-)) 
One easily checks that 

(2.21) £({</> G C x ([0,T] x [0,L]); (pJ9| holds}) is dense in L l (0,T) x L^O,^). 



Proceeding as for the proof of (2.181, we deduce from (2.201 and (2.21) 

\y(t,0)-u(t)\dt+ f \y(0,x)-y°(x)\dx = 0. 
o Jo 

This concludes the proof of Proposition |2.2| 



Exercise 2.3. Let T > 0, y° e L 2 (0,L) and u G L 2 (0,T) be given. Let 
y G C°([0, T]; L 2 (0, L)). Prove that y is a solution of the Cauchy problem (2.4)- 
\2.5\- |g.g|) if and only if, for every <fr G C 1 ([0, T] x [0, L\) such that 



4>(t,L) = 0,Vt£[0,T], 

<f>(T,x) = 0, Vie [0,L], 



one has 



T r L 



n 1 n Li pi pLi 

' / (<fo + (t> x )ydxdt + u(t)(j)(t,0)dt+ y°(x)<p(0,x)dx = 0. 
o Jo Jo Jo 



With Definition |2.1 1 one has the following theorem. 
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Theorem 2.4. Let T > 0, y° e L 2 (0,L) and it € L 2 (0,T) &e gwen. T/ien the 
Cauchy problem (2.4)-(2.5)-(2.6) has a unique solution. This solution satisfies 

\\y(r, -)IUw) < IIV°IUw) + NU»(o,T), Vr € [0,T]. 



(2.22) 



Proof of Theorem 2.4, Let us first prove the uniqueness of the solution 
to the Cauchy problem (2. 4)- (2.5 I- (2.6 1. Let us assume that y\ and j/2 are two 
solutions of this problem. Let y := 7/2 — Vi- Then y G C°([0, T]; L 2 (0, L)) and, if 
t € [0,T] and </> e ^([O,^ x [0,L]) satisfy ( |2?r| , one has 

pt pL pL 

(2.23) -/ / {<t>t + (t>x)ydxdt+ y{T,x)<P{T,x)dx = 0. 

Jo Jo Jo 

Let t G [0,T]. Let (f n ) n &i be a sequence of functions in C 1 (R) such that 

(2.24) /„ = on [L, +00), Vn e N, 

(2.25) f n \ {0 ,L) -» y(r, •) in L 2 (0, L) as n -> +00. 
For nel, let <p n € ^([O, r] x [0, L]) be defined by 

(2.26) 4> n (t, x) = f n {r + x-t), V(t, ar) S [0, r] x [0, L]. 
By ( |2.24| and ( |2.26| , ( [2?f| is satisfied for (/>:=</>„. Moreover, 

<t>nt + 4>nx = 0. 



Hence, from (2.231 with (f> := (f> n and from (2.261, we get 

(2.27) / j/(t, x)f n (x)dx = I y(r,x)cj) n (T,x)dx = 0. 

Letting n 







11 



00 in (2.271, we get, using (2.251, 

\y(T,x)\ 2 dx = 0. 


Hence, for every r € [0,T], j/(r, ■) = 0. 

Let us now give two proofs of the existence of a solution. The first one relies on 

the fact that one is able to give an explicit solution! Let us define y : [0, T] x [0, L] — > 

R by 

(2.28) y(t,x) :=y°{x-t), W(t,x) e [0,T] x (0,L) such that t < x, 

(2.29) y(t, x) := u{t - x), V(t, a;) G [0, T] x (0, L) such that t > x. 



Then one easily checks that this y is a solution of the Cauchy problem (2.4)-(2.5|- 
(2.6). Moreover, this y satisfies (2.221. 

Let us now give a second proof of the existence of a solution. This second proof 
is longer than the first one, but can be used for much more general situations (see, 
for example, Sections 2.2.1 2.4.1 2.5.11. 

Let us first treat the case where 

(2.30) u e C 2 ([0, T]) and w(0) = 0, 



(2.31) 



y° eH\0,L) and jy°(0) = 0. 



Let A : V(A) C L 2 (0, L) — > L 2 (0, L) be the linear operator defined by 

(2.32) V(A):={feH 1 (0,L);f(0) = 0}, 

(2.33) Af := -f x , V/ G V{A), 
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Note that 

(2.34) 

(2.35) 



V(A) is dense in L 2 (0,L), 
A is closed. 



Let us recall that (2.351 means t hat { (/, Af); f € T>(A)} is a closed subspace of 
L 2 (0,L) x L 2 (0,L); see Definition 



that, for every / € T>{A), 
(2.36) (AfJ) LH0 ,L) 



A.l 



on page 



373 



/ ffxdx 
Jo 



Moreover, A has the property 
f(L) 2 



<0. 



One easily checks that the adjoint A* of A is defined (see Definition A. 3 

by 

V(A*):={feH 1 (0,L);f(L) = 0}, 
A*f := /*, V/ G V{A*). 
In particular, for every / € D(A*), 



on page 



373) 



(2.37) 



(A*fJ) L 2 (0tL) = / ff x dx 
Jo 



/(0) : 



s: o. 



rem 



Then, by a classical result on inhomogeneous initial value problems (Theo- 
~on page[375l, (|2.30|), (|2.31|, (|2.34|), (|2.35|, (|2.36|) and (|2.37|, there exists 



A.7 



z e C\[0, T}; L 2 (0, L)) n C°([0, T]; 7^(0, L)) 
such that 
(2.38) 

(2.39) 

(2.40) z(0,-) = y 
Letye C 1 ([0,r];L 2 (0,L))nC ([0,T]; J ff 1 (0, J L)) be defined by 

(2.41) y(t, x) = z(t, x) + u(t), V(i, a;) e [0, T] x [0, L\. 



z{t,0) = 0, Vie [0,T], 

— = Az — u, 
dt 

..o 



Let r e [0,T]. Let </> G C^O, r]; L 2 (0, L)) n C°([0, r]; ff^O, L)). Using ( |2.30| , 
(2.381, (2.39), (2.401 and (2.41), straightforward integrations by parts show that 



(2.42) 



T pL pT pT 

\ {4> t + <l>x)ydxdt+ \ y(t, L)(j)(t, L)dt - / u{t)<p{t,0)dt 
o Jo Jo Jo 

pL pL 

+ / y(T,x)4>(T,x)dx — / y (x)4>(0 1 x)dx = 0. 
Jo Jo 



In particular, if we take (j) '■= 2/I[o.t]x[o.l]> then 

(2.43) f T \y(t,L)\ 2 dt- [ T \u(t)\ 2 dt+ f \y(r,x)\ 2 dx- f \y°( 
Jo Jo Jo Jo 

which implies that 

(2.44) \\y(T,-)\\v(o,L) < ||«||z»(o,T) + ||»°||L»(o,i), Vre [0,T], 



x)\ 2 dx = 0, 



that is (2.22). 
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2') 



Now let y° G L 2 (0,L) and let m € L 2 (0,T). Let (y°)nGN be a sequence of 
functions in T>(A) such that 

(2.45) y° -> 2/° in L 2 (0,L) as n ^ +oo. 

Let (it„)„ e H be a sequence of functions in C 2 ([0, T]) such that u„(0) = and 

(2.46) u n — ► u in L (0,T) as n — > +oo. 

For neN, let z„ G C'-flO, T]; L 2 (0, L)) n C°([0, T]; fl^O, L)) be such that 

(2.47) z„(t,0) = 0, Vte[0,T], 

dz„ 

(2.48) -^ = Az„ - u n , 

(2.49) z„(0,-) = 2/°, 

and let y n G C^QO, T]; L 2 (0, L)) n C°([0, T]; ff^O, L)) be defined by 

(2.50) y n {t,x) = z n {t,x) + u n {t),V{t,x) £ [0,T] x [Q,L). 



Let t G [0,T\. Let G C x ([0,t] x [0,L]) be such that <j>(;L) = 0. From ( |2.42| 
(applied with y° := y®, u := u n and J/ := y n ), one gets 



(2.51) 



(4>t + (j) x )y n dxdt - I u n (t)4>(t,Q)dt 

y n (r,x)(p(T,x)dx — / 2/„(cc)<?!>(0,cc)da; = 0, Vn G N. 



From (2.44 1 (applied with y° := y°, w := «„ and y := 2/n), 

(2-52) Hzm||c°([0,T];L 2 (0,.L)) < IW|£3(0,T) + ll?/n II L 2 (0,L) • 

j/^, u := u n - u m and 



.'A, 



Let (n,m) G N 2 . From (2.44 1 (applied with y° 
2/ := Vn~y m ), 

(2.53) ||j/„ - ym||c»([0,T];L2(0,L)) < \Wn ~ ttm||i3(0,T) + ||j/° ~ 2/mlU 2 (0,L)- 



From( |2.45| , ( |2.46| and ( pT53| ), (y„)„ eN is a Cauchy sequence in C°([0, T]; L 2 (0, L)). 
Hence there exists y G C u ([0, T]; L 2 (0, L)) such that 

(2.54) y„ -> y in C°([0, T]; L 2 (0, L)) as n -» +oo. 



From ( |2.51[ ) and ( |2.54| , one gets (|2_8|). From ( |2.52| and ( |2.54[ ), one gets (|2_22j). This 
concludes our second proof of the existence of a solution to the Cauchy problem 
(pT4t)-((2T5l)-(f2T6]) satisfying (|2~22J). ■ 



2.1.2. Controllability. Let us now turn to the controllability of the control 
system (2.2 l-(2.3l. We start with a natural definition of controllability. 



Definition 2.5. Let T > 0. The control system (2.2l-(2.3l is controllable in 
time T if, for every y° G £ 2 (0, L) and every y 1 G L 2 (0, L), there exists u G L 2 (0, T) 
such that the solution y of the Cauchy problem (2.4)-(2.5)-(2.6) satisfies y(T, •) = 
V 1 . 

With this definition we have the following theorem. 



Theorem 2.6. The control system (2.2)-(2.3) is controllable in time T if and 
only if T Js L. 
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Remark 2.7. Let us point out that Theorem |2.6| on the previous page shows 
that there is a condition on the time T in order to have controllability. Such 
a phenomenon never appears for linear control systems in finite dimension. See 
Theorem 1.16 on page [9] However, note that such a phenomenon can appear 
for nonlinear control systems in finite dimension (see for instance Example 6.4 on 
page 



1901 



We shall provide three different proofs of Theorem 2.6 



1. A proof based on the explicit solution y of the Cauchy problem (2.4)-(2.5) 



(2.61 



2. A proof based on the extension method. 

3. A proof based on the duality between the controllability of a linear control 
system and the observability of its adjoint. 

2.1.2.1. Explicit solutions. Let us start the proof based on the explicit solution 



of the Cauchy problem ([2T4|)-([2T5[)-([2T6|>. We first take T G (0,L) and check that 
the control system (2.2|-(2.3| is not controllable in time T. Let us define y° and y 1 
by 

y°(x) = 1 and y 1 {x) = 0, Vs G [0,L]. 

Let u G L 2 {0,T). Then, by ( |2.28| , the solution y of the Cauchy problem ( pEIfr - 
fl2!5])-(|2li]) satisfies 

y(T,x)=l,xe(T,L). 



In particular, y(T,-) ^ y . This shows that the control system (2.2 (-(2.3 1 is not 
controllable in time T. 



We now assume that T ^ L and show that the control system (2.2 1- (2.3) 



is controllable in time T. Let y° G L 2 (0,L) and y 1 G L 2 (0, L). Let us define 
u£ L 2 {0,T) by 

u(t) = y\T-t),te(T-L 1 T), 
u(t) =0, t G (0,T-L). 



Then, by (2.29), the solution y of the Cauchy problem (2.4)- (2.5 I- (2.6 I satisfies 
y(T,x) = u(T - x) = y 1 (x), x € (0,L). 



This shows that the control system (2.2 I- ( 2 .3 1 is controllable in time T 



2.1.2.2. Extension method. This method has been introduced in [425 by David 
Russell. See also [4261 Proof of Theorem 5.3, pages 688-690] by David Russell and 



[332] by Walter Littman. We explain it on our control system (2.2)-(2.3) to prove 



its controllability in time T if T ^ L. Let us first introduce a new definition. 



Definition 2.8. Let T > 0. The control system (2.2l-(2.3l is null controllable 
in time T if, for every y° G L 2 (0, L), there exists u G L 2 (0, T) such that the solution 



y of the Cauchy problem ((2_4]-(|2_5|-(|2_6|) satisfies y(T, ■) = 0. 
One has the following lemma. 



Lemma 2.9. The control system (2.2)-(2.S) is controllable in time T if and 
only if it is null controllable in time T. 
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Proof of Lemma |2.9[ The "only if" part is obvious. For the "if" part, let 



us assume that the control system ( 2.2 l-( 2.3 ) is null controllable in time T. Let 



y° G L 2 (0,L) and let y 1 G L 2 (0, L). Let us assume, for the moment, that there 
exist y° G L 2 (0,L) and u G L 2 (0,T) such that the solution y G C°([0, T]; L 2 (0, L)) 
of the Cauchy problem 



(2.55) 

(2.56) 

(2.57) 

satisfies 

(2.58) 



yt + y x = 0, te(0,T), ie (0,L), 

y(i,0)=w(t),ie(0,T), 

y(0,a:) = y ( a :),a:e(0,L), 

y(T,x) :=y 1 (a;), a :e(0,L). 



Since the control system ( 2.2 1-( 2.3 ) is null controllable in time T, there exists 



U G L 2 (0, T) such that the solution y G C°([0, T]; L 2 (0, L)) of the Cauchy problem 

(2.59) yt + y* = o, te(o,T), se(o,L), 

(2.60) jf^O) =«(«),< 6(0, r), 

(2.61) s(0,i)=),V)-i o (x),^(0-£)- 
satisfies 

(2.62) jf(T,a;):=0 > a:€(0,L). 
Let us define it G L 2 (0, T) by 

(2.63) u := u + u. 

From (|2.55| to (|2.57[) and dgjgt to (|2.6l|, the solution y G C°([0, T]; L 2 (0,L)) of 



the Cauchy problem 



yt + y x = o, te(o,T), ie (o,i), 

p(t,0)=«(t) I te(0,T) 1 

2 /(0,a:) = 2 / ( a; ),a:e(0,L), 



1 Hence, as desired, the control u 



is y = y+ y. By (|2.58|) and by J2.62|), y(T, ■) = y 

steers the control system (2.2 l-(2.3l from the state y° to the state y 1 during the time 



interval [0, T]. It remains to prove the existence of y° € L 2 (0, L) and u € L 2 (0, T). 
Let z e C°([0, T]; L 2 (0, L)) be the solution of the Cauchy problem 



(2.64) 
(2.65) 
(2.66) 



Zt + z x = o,te (o,T), xe (o,L), 
«(t,o) = o,te(o,T), 

z(0,x) = y\L-x), xe (0,L). 



Note that from ( |2.64| we get z G i? 1 ((0,L);//' _1 (0,T)). In particular, z(-,L) is 
well defined and 

(2.67) z(',L)€H-\0,T). 

In fact z(-,L) has more regularity than the one given by (2.67 1: one has 

(2.68) z(-,L) GL 2 (0,T). 



Property (2.681 can be seen by the two following methods. 
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For the first one, one just uses the explicit expression of z; see (2.28) and 



(2.29) 



- For the second one, we start with the case where y 1 G i7 1 (0,L) satisfies 
y 1 {L) = 0. Then z e C 1 ([0,T];L 2 (0,L))n C°([0,T]; 7^(0, L)). We multi- 



(2.69) 



ply ( 2.64 1 by z and integrate on [0, T] x [0,L]. Using (2.651 and (2.661, we 
get 

"L fL pT 

z(T,xfdx- y 1 (x) 2 dx + z(t,L) 2 dt = 0. 
Jo Jo 

In particular, 

lk(-,i)||i»(O 1 T)<||y 1 |U»(0,L). 

By density, (2.69) also holds if y 1 is only in L 2 (0, L), which completes the 



second proof of (2.68) 



We define y° G L 2 (0, L) and u G L 2 (0, T) by 

y°(s) = z(T,L-3;), xG(0,L), 
te(t) = z(T-t,L), te (0,T). 



(2.571 is 



Then one easily checks that the solution y of the Cauchy problem (2.55 )-( 2.56) 
y(t, x) = z(T - t, L - x), t G (0, T), x G (0, L). 



(2.70) 



From (2.661 and (2.701, we get (2.58). This concludes the proof of Lemma 2.9 



Remark 2.10. The fact that z(-,L) G L 2 (0,T) is sometimes called a hidden 
regularity property; it does not follow directly from the regularity required on z, 
i.e., z G C°([0, T]; L 2 (0, L)). Such a priori unexpected extra regularity properties 



appear, as it is now well known, for hyperbolic equations (see in particular (2.307 ) on 



page[68] [285. by Heinz-Otto Kreiss, [43H, 1432] by Reiko Sakamoto, [HI Theoreme 
4.4, page 378] by Jacques Chazarain and Alain Piriou, |297l 1298] by Irena Lasiecka 
and Roberto Triggiani, 324, Theoreme 4.1, page 195] by Jacques-Louis Lions, [473 
by Daniel Tataru and [277, Chapter 2] by Vilmos Komornik. It also appears for our 
Korteweg-de Vries control system studied below; see (2.1401 due to Lionel Rosier 
[4071 Proposition 3.2, page 43]. 

Let us now introduce the definition of a solution to the Cauchy problem 

(2.71) yt + y x = 0, (t, x) e (0, +00) x R, y(0, x) = y°{x), 

where y° is given in L 2 (K). With the same motivation as for Definition 



2.1 



page 25 one proposes the following definition. 



Definition 2.11. Let y° G L 2 (E). A solution of the Cauchy problem (2.71) 
is a function y G C°([0, +00); L 2 (K)) such that, for every r G [0,+oo), for every 
R > and for every <f) G C 1 ([0, r] x E) such that 

4>(t, x) = 0, Vt G [0, t], VieK such that \x\ > R, 

one has 

i-R r R r R 



{4>t + 4> x )ydxdt ■ 



-R 



y(r, x)4>(T,x)dx 



-R 



y°(x)(/)(0,x)dx = 0. 
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Then, adapting the proof of Theorem |2.4| on page |27[ one has the following 
proposition. 



Proposition 2.12. For every y° G L 2 (R), the Cauchy problem (2.71) has a 
unique solution. This solution y satisfies 

l|y(r,-)IU=(K) = l|j/°ll^(a)>Vr€ [0,+oo). 



In fact, as in the case of the Cauchy problem (2.4l-(2.5l-(2.6l, one can give y 
explicitly: 

(2.72) y(t, x) = y°(x - t), t G (0, +oo), x G K. 

Then the extension method goes as follows. Let y G L 2 (0,L). Let 7? Js 0. Let 
y° G L 2 (R) be such that 

f(x) = y°(x),xe(0,L), 

y°(x) = 0,i£ (-oo, -R). 

be the solution of the Cauchy problem 

yt + Vx=0,t€ (0,+oo), xGR, 

y(0 7 x) = y°{x),xeR. 



(2.73) 
(2.74) 
Let y G C°([0, +oo); L 2 



Using ( 2.74 I and the explicit expression ( 2.72 ) of the solution of the Cauchy problem 
(2.71 1, one sees that 

(2.75) y(t,x)=Q\ix<t- R. 



Adapting the proofs of (2.681, one gets that 

y(-,0)GL 2 (0,+oo). 

Let T Js L. Then one easily checks that the solution y G C ([0, T\\ L 2 (Q, L)) of the 
Cauchy problem 

y t + y x = 0,te{0,T),xe (0,L), 
y(t,0) = y(t,0),te(0,T), 
y(0,x) = y°(x),xe(0,L), 



is given by 
(2.76) 



y(t,x) =y(t,x), t € (0,T), x € (0,L). 



From ( |2.75[ ), one gets y(T,A = Oif-R< T-L. Hence the control* G (0,T) h-> y(t,0) 



steers the control system ( 2.2 l-( 2.3 ) from the state y° to during the time interval 
[0,31- 



Of course, for our simple control system (2.2 )-( 2.3 I , the extension method seems 



to be neither very interesting nor very different from the explicit method detailed 



in Section 2.1.2.1 (taking R = leads to the same control as in Section 2.1.2.11 



However, the extension method has some quite interesting advantages compared to 
the explicit method for more complicated hyperbolic equations where the explicit 
method cannot be easily applied; see, in particular, the paper [332] by Walter 
Liftman. 

Let us also point out that the extension method is equally useful for our simple 



control system (2.2l-(2.3l if one is interested in more regular solutions. Indeed, let 



m G N, let us assume that y° G H rn (0 1 L) and that we want to steer the control 



:U 
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system (2. 2)- (2. 3) from y° to in time T > L in such a way that the state always 
remains in H m (0,L). Then it suffices to take R :=T — L and to impose on y° to be 
in H m (R). Note that if m ^ 1, one cannot take T = L, as shown in the following 
exercise. 

Exercise 2.13. Let m e N\ {0}. Let T = L. Let y° e H m (0,L). Prove 
that there exists u € L 2 (0,T) such that the solution y € C°([0, T]; L 2 (0, L)) of the 
Cauchy problem (2.4)-(2.5)-(2.6) satisfies 



if and only if 



y(T,x) = 0,xe(0,L), 

y (t 7 -)eH m (o,L),vte[o,n 

(y°)^(0) = 0,\/je{0,...,m-l}. 



Remark 2.14. Let us emphasize that there are strong links between the regu- 
larity of the states and the regularity of the control: For r Jj 0, if the states are in 
H r (0,L), one cannot have controllability with control u € H s (0,T) for 



(2.77) 



s > r. 



Moreover, (2.77) is optimal: For every T > L, for every y° € H r (0,L) and for 
every y 1 e H r (0 , L), there exists u € H r (0,T) such that the solution y of the 
Cauchy problem Q-^-Q satisfies y(T, ■) = y 1 and y E C°([0, T];H r (0, L)). 
Of course this problem of the links between the regularity of the states and the 
regularity of the control often appears for partial differential equations; see, in par- 
ticular, Theorem |9.4| on page |248} The optimal links often are still open problems; 



see, for example, the Open Problem 9.6 on page 251 



2.1.2.3. Duality between controllability and observability. Let T > 0. Let us 
define a linear map Tt '■ L 2 (0, T) — > L 2 (0, L) in the following way. Let u G L 2 (0 , T) . 
Let y e C°([0, T\; L 2 (0, L)) be the solution of the Cauchy problem (|2~4|-([2~5|-([2~6l) 
with y° := 0. Then 

T T {u):=y{T,-). 
One has the following lemma. 



Lemma 2.15. The control system (2.2)-(2.3) is controllable in time T if and 
only if Tt is onto. 



"only if" part is obvious. Let us assume that 



Proof of Lemma [27T5J The 

Tt is onto and prove that the control system (2.2 (-(2.3 1 is controllable in time T. 
Let y° € L 2 (0, L ) and y 1 € L 2 (0, L). Let y be the solution of the Cauchy problem 

(2.4)-(2.5 )-(2.6) with u := 0. Since Tt is onto, there exists u G L 2 (0, T ) such that 

r — 



Ft(u) = y 
satisfies y(T 



y(T, •). Then the solution y of the Cauchy problem (2.4l-(2.5l-(2.6) 
I = y(T, •) + y 1 — y(T, ■) = y , which concludes the proof of Lemma 



In order to decide whether Tt is onto or not, we use the following classical result 
of functional analysis (see e.g. [4191 Theorem 4.15, page 97], or [711 Theoreme 11.19, 
pages 29-30] for the more general case of unbounded operators) . 
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:;r> 



Proposition 2.16. Let ffi and -ff 2 be two Hilbert spaces. Let J 7 be a linear 
continuous map from Hi into H 2 . Then T is onto if and only if there exists c > 
such that 



(2.78) 



\T*{x 2 )\\ H , > c\\x 2 \\ H2 ,Vx 2 e H 2 



Moreover, if (2.78) holds for some c > 0, there exists a linear continuous map Q 
from H 2 into Hi such that 

T ° Q(x2) = x 2 , \/x 2 e H 2 , 

\\Q{x 2 )\\ Hl ^-IM^.ViraGffa. 
c 



In control theory, inequality (2.781 is called an "observability inequality". In 
order to apply this proposition, we make explicit T^ in the following lemma. 

Lemma 2.17. Let z T e H l (0,L) be such that 

(2.79) z T (L) = 0. 

Let z e C 1 ([0,T];L 2 (0,L))nC°([0,T];# 1 (0,L)) be the (unique) solution of 

(2.80) z t + z x = 0, 

(2.81) z(t,L) = 0, Vi€ [0,7], 

(2.82) z(T,-) = z T . 
Then 

(2.83) T* T {z T ) = z{-,0). 

Proof of Lemma |2.17[ Let us first point out that the proof of the existence 
an d uniq ueness of z e C x ([0,T];£ 2 (0,I/)) n C°([0,T]; H l (0,L)) satisfying ( |2.80| ) 
to (|2.82[ ) is the same as the proof of the existence and uniqueness of the solution 
of {gggf to fl2.40| ). In fact, if z € C^QO, T]; L 2 (0, L)) n C°([0, T]; ff^O, L)) is the 
solution of 

z{t,0) = 0, Vie [0,T], 
di 



d/ 



Az, 



then 



5(0, x) = z T (L-x),\/x e [0,L], 



z(t,x) = z(T-t,L-x),y(t,x) e [0,7] x [0,L]. 



Let u e C 2 ([0,T]) be such that u(0) = 0. Let 



2 /eC 1 ([0,T];L 2 (0,L))nC°([0,T];7J 1 (0,L)) 



be such that 




(2.84) 


Vt + Vx = o, 


(2.85) 


y(t l 0)=«(t),VtG[0,r| 


(2.86) 


y(o,-) = o. 



:>,<; 
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(Again the existence of such a y is proved above; see page 28 ) Then, from (2.801 
fl2.81|, (|2.82[), (|2.84|, (|2.85[) and fl2.86|, we get, using integrations by parts, 



L ,-L 

z J^T^dx = / z y(T,x)dx 

ii Jo 

T rL 

/ (zy)tdxdt 

:i Jo 

T ,>£ 



z(t,0)u(t)dt, 



which, since the set of u € C 2 ([0,T]) such that w(0) = is dense in L 2 (0,T), 
concludes the proof of Lemma |2.17| ■ 



From Lemma 2.17 it follows that inequality (2.78) is equivalent to 

f-T 



(2.87) 



z(t,0) 2 dt ^ c 2 / z T (x) 2 dx, 
:i J a 



for every z T G H 1 ^^) such that (2.79) holds, z being the (unique) solution of 
(|2.80|-(|2.81|-(|2.82| in C l {[Q, T]; L 2 (0, L)) n C°([0, T]; if^O, L)). 



Let us now present two methods to prove (2.87). The first one relies on the 



explicit solution of (2.80)-(2.81 )-(2.82 ), the second one on the so-called multiplier 
method. 



Proof of (2.87) by means of explicit solutions. We assume that T ^ L. 



One notices that the solution of ( 2.80 )-( 2.81 )-( 2.82) is given (see also (2.28) and 
(p9))by 



z(t, x) = z T (x + T-t) if 0<x<L + t-T, 
z(t, x) = 0, ifL + t - T < x < L. 



In particular, since T > L, 



z(t,0) 2 dt 



[ L z T (xy 

Jo 



dx. 



showing that (2.871 holds with c = 1. 



Proof of (2.87) by means of the multiplier method. We now assume 



that T > L and prove that the observability inequality (|2.87| indeed holds with 
(2.88) 



C : = 



T-L 



Let z T <E H X {Q,L) be such that (2.79) holds. Let 



z e C\[0, T}; L 2 (0, L)) n C°([0, T]; ^(0, L)) 
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be the (unique) solution of (2.80 I to (2.82 ). Let us multiply (2.801 by z and integrate 
the obtained equality on [0, L\. Using (2.81 1, one gets 



(2.89) 



d 

d7 



\z{t,x)\ 2 dx = \z(t,0)\ 2 



Let us now multiply (2.80) by xz and integrate the obtained equality on [0,L]. 
Using (2.81 1, one gets 



(2.90) 



d 
d7 



x\z(t, x)\ 2 dx 



\z(t,x)\ dx. 



For t e [0,T], let e(t) := / \z(t,x)\ 2 dx. From (2.90), we have 

i-T 

e(t)dt 



/ e{t)dt= 
Jo Jo 



(2.91) 



From ( |2.89| , we get 
(2.92) e(t) = e(T) 



L [-L 

x\z(T, x)\ 2 dx — / x\z(0,x)\ 2 dx 
o Jo 

^L J \z{T,x)\ 2 dx = Le{T). 
Jo 



|z(T,0)| 2 dr> e(T)- f |z(r,0)| 2 dr. 



From ( |2.82| , ( |2.91[ ) and ( |2.92| , we get 
(2.93) 

on page 



(T-L)||z'||£ a(0 . L) <r / \z{t,\ 

o 



'rfr. 



which, together with Lemma 



2.17 
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and the density in L 2 (0,L) of the 



functions z € i? 1 (0,L) such that (2.79) holds, proves the observability inequality 
(12.87} with c given by pi 



Remark 2.18. Since 



T - L 



< 1, VT > L > 0, 



the multiplier method gives a weaker observability inequality (2.87 1 than the method 
based on explicit solutions, which gives the optimal inequality. (Note also that the 
multiplier method, in contrast with the method based explicit solutions, does not 
allow us to prove the controllability in the limiting case T = L.) However, the 
multiplier method is quite flexible and gives interesting controllability results for 
many partial differential linear control systems; see, for example, Section 2.4.2 and 
the references in Remark 12. 191 

Remark 2.19. The multiplier method goes back to the paper |362] by Cathleen 
Morawetz. In the framework of control systems, it has been introduced in [234 
by Lop Fat Ho, and in [326J, 1325] by Jacques-Louis Lions. For more details and 
results on this method, see the book |277j by Vilmos Komornik and the references 
therein. 

Remark 2.20. One can find much more general results on the controllability 
of one-dimensional hyperbolic linear systems in |423[ ]424, 426J by David Russell. 
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2.2. Korteweg-de Vries equation 

This section is borrowed from the paper [40 7j by Lionel Rosier. Let L > and 
T > 0. We consider the linear control system 



(2.94) 
(2.95) 



Vt + Vx + Vxxx = 0, t G (0,T), x e (0, L), 
y(t, 0) = y(t, L) = 0, y x (t, L) = u{t), t G (0, T), 



where, at time t, the control is u(t) G K and the state is y(t, ■) : (0, L) i— > R. Our goal 
is to study the controllability of the control system ( 2.94 1-( 2 .95 I . Again we start 
by studying the well-posedness of the Cauchy problem associated to (2. 94)- (2. 95). 

2.2.1. Well-posedness of the Cauchy problem. Let us first give a natural 
definition of solutions of the Cauchy problem 



(2.96) 
(2.97) 
(2.98) 



Vt + Vx + Vxxx = 0, t € (0,T),xe (0,L), 

y{t, 0) = y(t, L) = 0, y x {t, L) = u(t), t € (0, T), 

y(0,x) = y°(x),xe(0,L), 



where T > 0, y° € L 2 (0,L) and u G L 2 (0,T) are given. In order to motivate 
this definition, let us first assume that there exists a function y of class C 3 on 
[0,T] x [0,L] satisfying ( |2.96[ ) to ( |2.98| in the usual sense. Let r G [0,T] and let 
G C 3 ([0, r] x [0, L\) be such that 



(2.99) 



0(i,O) = 0(f , L) = 0, V* G [0,t]. 



We multiply (2.96) by cf> and integrate the obtained equality on [0, r] x [0, L]. Using 
(|2.97|, (|2.98|), (2.991 and integrations by parts, one gets 

(4>t + 4>x + <pxxx)ydxdt - / u(t)4> x (t,L)dt+ / y x (t,Q)(j> x (t,0)dt 

ii .In Jo Jo 

L ,-L 

y(r, x)<P(t, x)dx — I y°(x)<j>(0,x)dx = 0. 
o Jo 

This equality leads to the following definition. 

DEFINITION 2.21. Let T > , y° G L 2 (0,L ) and u G L 2 (0,T) be given. A solu- 
tion of the Cauchy problem \2.9^ -{ 2^ - (2.9^ is a function y G C°([0,T]; L 2 (0, L)) 
such that, for every t£ [0, T] and for every </> G C 3 ([0, r] x [0, L]) such that, 



(2.100) 
one has 

(2.101) 



cf>(t, 0) = <f>(t, L) = </> x (t, 0) = 0, Vi G [0, r] 



(</>t + 4>x + <t>x 



)ydxdt 
L 



u(t)(f> x (t,L)dt 



y(T,x)4>(T,x)dx 



y°(x)(/)(0,x)dx = 0. 



Proceeding as in the proof of Proposition |2 . 2 1 on page [25] one gets the following 



proposition, which also justifies Definition |2. 21 
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Proposition 2.22. Let T > 0, y° e L 2 (0,L) an d u g L 2 (0,T ) &e g iven. Let 
us assume that y is a solution of the Cauchy problem (2.96)- (2.91)- (2.98) which is 
of class C 3 in [0,T] x [0,1,]. Then 

y°gC 3 ([0,L]), 

ueC 2 ([0,T}), 

V(0,*) = y°(»).V*G[0,i] > 

y(i,0) = 2/(i,L) = 0, fcfti) = u(t), Vt g [0,T], 

ife(t, *) + p a (t, a;) + fc^t, a:) = 0, V(t, a:) g [0, T] x [0, L]. 



With Definition 2.21| one has the following theorem. 

Theorem 2. 23. L e tT > y° g L 2 (0,L) and« g L 2 (0,T) &e gwen. Then the 
Cauchy problem (2.96)-(2.91)-(2.98) has a unique solution. This solution satisfies 

(2.102) ||j/(r,-)||^(o,i) < ||y |U»(o,L) + NU»(o,T) > Vrg[0,T]. 

Proof of Theorem |2.23[ We start with the existence statement. We proceed 
as in the second proof of the existence statement in Theorem |2.4| on page |27| Let 
T > 0. Let us first treat the case where 

(2.103) ueC 2 {[0,T}), 

(2.104) u(0)=0, 

(2.105) y° g tf 3 (0, L), y°(0) = y°(L) = y£(L) = 0. 

Let A : V(A) C L 2 (0, L) — > L 2 (0, L) be the linear operator defined by 



(2.106) 
(2.107) 

Note that 

(2.108) 
(2.109) 
Moreover, 

(2.110) 



V(A) := {/ g H 3 (0,L); /(0) = f(L) = f x (L) = 0}, 
Af ■= -U - /***, V/ g ©(A). 

©(A) is dense in L 2 (0,L), 
A is closed. 



{Af, /)z,2(o,L) 



(,/:£ ~r Jxxx) J O/X 



MO)' 



<o. 



One easily checks that the adjoint A* of A is defined by 

V(A*) := {/ g # 3 (0,L); /(0) = / x (0) = /(L) = 0}, 

A*f:=f x + f xxx ,\/feV(A*). 

In particular, 



(2.111) 



(A*f,f)L 2 (0.L) 



\Jx i Jxxx J J ^^ 



ULf 



£0. 



Then, by a classical result on inhomogeneous initial value problems (Theorem A. 7 
on page 



3751, (2.1031, (2.1051, (2.108), (2.109), (2.1101 and (2.111), there exists 



z g ^([0, T\; L 2 (0, L)) n C°([0, T]; tf 3 (0, L)) 
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such that 

(2.112) z(t,0) = z(t,L) = z x (t,L) = 0, V£ G [0,T], 

dz , , x(L — x) , , L — 2x 

(2.113) — = Az + u[t) l - ' +u(t)— — , 

(2.114) <0,-) = y°. 

Let ye C 1 ([0,T];L 2 (0,L))nC ,0 ([0,T]; J ff 3 (0,L)) be defined by 

(2.115) y(t,x) = z(t,x) -m(*) ~ X ' ,V{t,x) G [0,T] x [0,L). 



Note that, from (|2_112j) and ( |2.115| , 

(2.116) y(t,0) = y(t,L),Vte[0,T]. 

Let tG [0,T]. Let 0G C 1 ^, r]; L 2 (0, L)) n C°([0, r]; 7J 3 (0, L)) be such that 

(2.117) 4>(t, 0) = <£(i, L) = 0, V* G [0, T\. 



Using ( |2.104[ ), ( |2.112| , ( |2.113| , \2.l\A\ and ( |2.115| , straightforward integrations by 
parts show that 

(2.118) 

pT pL pT pT 

~ (4>t + §x + <f> xxx )ydxdt - / u(t)<f) x (t,L)dt+ / y x (t,Q)<j> x (t,Q)dt 

Jo Jo Jo Jo 

+ / y(r,x)<p(T,x)dx — / j/ (x)^(O, x)da; = 0. 
Jo Jo 



In particular, if we take <p := y|[o. T ]x[o.L] ( see a l so (2.1 16 1) , then 

fT pT pL pL 

(2.119) / \y x (t,0)\ 2 dt- \u(t)\ 2 dt + \y(T,x)\ 2 dx- \y°(x)\ 2 dx = 0, 
Jo Jo Jo Jo 

which implies that 

(2.120) \\y\\c°(l0,T];LH0,L)) < ||w||l=»(0,T) + lb°ll^(0,L)- 

Now let y° € L 2 (0,L) and let m G L 2 (0,T). Let (y°) n gN be a sequence of 
functions in T>(A) such that 

(2.121) y° -> y° in L 2 (0,L) as n ^ +oo. 

Let (w n ) n gN be a sequence of functions in C 2 ([0, T]) such that u„(0) = and 

(2.122) u n -> u in L 2 (0, T) as n -> +oo. 

For nGN, let z„ G C^QO, T]; L 2 (0, L)) f~l C°([0, T]; ff 3 (0, L)) be such that 

(2.123) z n (t,0) = z n (i,L) = z na: (*,L) = 0, Vi G [0,T], 



(2.124) 
(2.125) 



dz„ #(£ — x) L — 2x 

— — = Az n + u n (t) \-u n (t) — - — , 

at L L 



zn(0,-) = yl, 

and let j/„ G C^QO, T]; L 2 (0, L)) n C°([0, T]; # 3 (0, L)) be defined by 

s(L — a;) 



(2.126) 



y n (t,x) = z„(t,x) - u n {t)- 



L 



V{t,x) G [0,T] x [0,L]. 
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Let r € [0,21 . Let</>G C 3 ([0,t] x [0, L\) be such that </>(■, 0) = <j> x {-,0) = </>(•, L) = 0. 
From (2.1181 (applied to the case where y° := y^, u := u n and y := y n ), one gets 

(2.127) - / / (4> t + 4> x + 4>xxx)Vndxdt - / u n (t)4>x(t,L)dt 
Jo Jo Jo 

y n {r,x)(f>(T,x)dx - / y°(a;)(/i(0,a;)da; = 0. 
o Jo 

From (2.1201 (applied to the case where y° := y„, u := u n and y := y n ), 

(2-128) ||yn||c»([0,T];I,2(0,i)) < ||«n||z3(0,T) + \\Vn IU 2 (0,£)- 

Let (n,m) G N 2 . From (2.1201 (applied to the case where y° := y° — y^, m := 



u n - u m and y 



y m ), 



(2.129) ||j/ n - y m \\c°([0,T];m0,L)) < ||«n ~ Wmlli^O.T) + ll^n ~ J/m IU 2 (0,i) • 



From (2.121), (2.1221 and (2.1291, one gets that the sequence (y n )neti ls a Cauchy 
sequence in c\[0,T}; L 2 (0, L)). Hence there exists y G C°([0, T]; L 2 (0,L)) such 
that 



(2.130) 



zj„^yinC°([0,T];L 2 (0,L)) asn^+c 



From ( |2.127| ) and fl2.130| , one gets (|2_101|. From (|2_128j) and (|2_130j), one gets 
(2.1021. This concludes our proof of the existence of a solution to the Cauchy 
problem (|2.96|)-(|2.97|)-(|2.98|) satisfying (12.102 1. 



Let us now turn to the proof of uniqueness. Let us assume that, for some 
T > 0, y° G L 2 (0,L) and u G L 2 (0,T), the Cauchy problem ( |2.96[ )-( |2.97[ )-( |2.98[ ) 
has two solutions y\ and y%. Let y := 3/2 — 2/i € C°([0,T]; L 2 (0, L)). Let r G 0,T] 
and G C 3 ([0,r] x [0,L]) be such that J2.100|) holds. Then, by Definition 
page [381 

(2.131) 



2.21 



+ <Ar + (pxxx)ydxdt + / j/(t, z)</>(t, a5)efcc = 0. 
Jo 



By an easy density argument, (2.131 ) in fact holds for every 

G ^([0, r]; L 2 (0, L)) n C°([0, t};H 3 (0, L)) 



such that (|2_100j) holds. 

Let t G [0, L\. Let (f n ) n &'i t> e a sequence of functions in H 3 (0,L) such that 

(2.132) /n(0) = /„(£) = A«(0) = 0, 

(2.133) /„ -> j/(t, ■) in L 2 (0, L) as n -> +00. 
For n G N, let 

(2.134) V« e ^([O, r]; L 2 (0, L)) n C°([0, r];2?(A)) 
be the solution of 

(2.135) ^t= A ^ 

(2.136) Vn(0,x) = / n (L-a;). 

Let <j) n GC 1 ([0,r];L 2 (0,L))nC°([0,T];i7 3 (0,L)) be defined by 

(2.137) 0„(t,s) :=ip n (T-t,L-x),V(t,x)€ [0,r] x [0,L]. 
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By (2.1341 and (2.137), (2.100) is satisfied for </>:=</>„. Moreover, 



Writ "T~ tyrix \ (pnxxx — U. 



Hence, from (2.131 1 with (p := (j) n and from (2.137), we get 

f'Li f'Li 

(2.138) / y{T,x)f n (x)dx= / y(r,x)cj)n(r,x)dx = 0. 



Letting n — > oo in (2.1381, we get, using (2.133), 

\y{T,x)\ 2 dx = 0. 
o 



Hence, for every r G [0,T], j/(r, •) = 0. This concludes the proof of Theorem 2.23 



2.2.2. Controllability. Let us now turn to the controllability of the control 



system (2.94)- (2.95 ). We start with a natural definition of controllability. 



Definition 2.24. Let T > 0. The control system (2.94 1-( 2.95 1 is controllable 
in time T if, for every y° G L 2 (0,L) and every y 1 G L 2 (0 , L), th ere exists u G 



L 2 (0, T) such that the solution y of the Cauchy problem (|2.96[)-(|2.97[)-(|2.98[) satisfies 

y(T, 



With this definition we have the following theorem, due to Lionel Rosier [407 
Theorem 1.2, page 35]. 



Theorem 2.25. Let 
(2.139) Af:= 



2tt 



j 2 + P + jl 



;j,l eN\{0} 



Let T > 0. The control system (2.94)-(2.95) is controllable in time T if and only 
ifLftAf. 



Proof of Theorem [2T25J We follow [407] by Lionel Rosier. For y° G L 2 (0, L), 
let y G C°([0, +oo); L 2 (Q, L)) be the solution of the Cauchy problem 

yt + y x + y XX x = 0, 

y(-,0) = y(-,L) = y x (-,L) = 0, 

y(0,-)=y°- 

(This means that, for every T > 0, y restricted to [0, T] x (0,L) is a solution of 



this Cauchy problem on [0, T] x (0,L) in the sense of Definition 2.21 



on page 



38 ) 



We denote by S(t)y° the function y(t,-). In other words, S(t), t G [0, +oo), is the 
semigroup of continuous linear operators associated to the linear operator A; see 
page [374] 

One of the main ingredients of the proof is the regularizing effect given in 



(2.1401 and (2.1411 of the following proposition due to Lionel Rosier. 



Proposition 2.26 ( |4071 Proposition 3.2, page 43]). For y° G L 2 {0,L), let 
T > 0, and y(t,-) := S(t)y° fort G [0,T]. Then y x (-,0) makes sense in L 2 (0,T), 
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l.i 



y€L 2 ((0,T);H 1 (0,L)) and 

(2-140) ||fo(-,0)||£ 3(Ol r)<||v |U»(o,i;), 



(2.141) 
(2.142) 



ll?/||L 2 ((0,T);ffi(0,L)) < 



/4T + L 
V 3 



1/2 



12/ IU 2 (0,L), 



lb \\lho,l) < ^l|j/IL=((0,T) X (0,i)) + ll^(-,0)|| L2(0 



r 



T)- 



The meaning of (2.1401 is the following. By (2.961 (which holds in the distri- 
butions sense) and the fact that y € C°([0, T]; L 2 (0, L)) we have that 

yei^Uo^tf-^T)) 



and therefore y x {-,0) makes sense and is in _ff~ 1 (0,T). Inequality (2.1401 tells 
us that y x (-,0) is in fact in L 2 (0,T) (and that the L 2 (0,T)-norm is less than or 
equal to the right hand side of (2.140)). This is a hidden regularity property; see 
on page 32 Let us remark that (2.141 1 is the Kato smoothing effect 



Remark 2.10 



[266j Theorem 6.2]). 

Proof of Proposition 



2.26 



By density of T>{A) in L 2 (0,L), we just need 



to prove the inequalities ( |2.140| , ( |2.14l| and ( |2.142| if y° e V{A). So, let us take 
y° eV(A). Then 



(2.143) 
(2.144) 
(2.145) 
(2.146) 



2 /eC 1 ([0,T];L 2 (0,L))nC o ([0,T];P(A)), 

Vt+Vx+ Vxxx = 0, 

y(-,0) = y(-,L) = y x (-,L) = 0, 



2/(0, 



y 



We mu ltiply ( |2.144[ ) by y and integrate on [0, T] x [0,L\. Using ( |2.144| , Q2.145| , 
(2.1461 and simple integrations by parts, one gets 

pi pL pL pL 

I \y x (t,0)\ 2 dt = \y°(x)\ 2 dx- \y(T,x)\ 2 dx^ \y°(x)\ 2 dx, 
o Jo Jo Jo 

which proves (2.1401. 

Let us now multiply (2.144 I by xy and integrate on [0, T] x [0, L\. Using (2.144 I, 



(2.1451, (2.1461 and simple integrations by parts, one gets 
(2.147) 



y(t,x)\ dxdt + / x\y(T, x)\ dx 

L pT pL 

x\y°{x)\ 2 dx + 3 / \y x {t,x)\ 2 dxdt = 0. 

ii Jo Jo 



Using (|2_102j), we get 

I|2/||l2((o,t)x(o,l)) < T 1/2 \\y\\ C o {[ o,T];Li(o,L)) < T 1/2 \\y \\ L 2 {0 , L): 

which, together with (2.147), gives (2.141). 

Finally, we multiply (2.144) by (T — t)y and integrate on [0,T] x [0,L]. Using 



(2.1441, (2.1451, (2.1461 and simple integrations by parts, one gets 

,-T r L r-L nT 

'-•'-" ' T\y°(x)\ 2 dx + (T-t)\y x (t,0)\ 2 dt = Q, 



\y(t, x)\ dxdt - 
o Jo Jo 



n 



which proves (2.1421. This concludes the proof of Proposition 2.26 
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In order to prove Theorem |2.25 we use the duality between controllability 
and observability (as in Section 2.1.2.3 for the transport equation). Let T > 0. 
Let us define a linear map Tt '■ L 2 (0,T) i— > L 2 (0,L) in the following way. Let 
u G L 2 (0,T ). Let y £ C°([0, T]; L 2 (0, L)) be the solution of the Cauchy problem 
( |2.96| -( |2.97| -( |2.98| with y° := 0. Then 

T T (u):=y(T,-). 



One has the following lemma, the proof of which is similar to the proof of Lemma |2.15| 
on page [3~4"| 



Lemma 2.27. The control system (2.94)-(2.95) is controllable in time T if and 
only if Tt is onto. 

Again, in order to decide whether Tt is onto, we use Proposition |2.16| on 



35 In order to apply this proposition, we make explicit T T in the following 



page 
lemma. 

Lemma 2.28. Let z T £ H 3 (0,L) be such that 

(2.148) z T (0) = zj(0) = z T (L) = 0. 

Let z e C 1 ([0,T];L 2 (0,L))nC ([0,T];7/ 3 (0,L)) be the (unique) solution of 

(2.149) zt + z x + z xxx = 0, 

(2.150) z(t, 0) = z x {t, 0) = z{t, L) = 0, Vi e [0, T], 

(2.151) z(T,-) = z T . 
Then 

(2.152) T T (z T ) = z x (-,L). 

Proof of Lemma 2.28| Let us first point out that the proof of the existence 
an d uniqu eness of z € C^fltyT]; L 2 (0, L)) n C°([0, T]; H 3 {0, L)) satisfying ( |2.149| ) 
to (2.151 ) is similar to the proof of the existence and uniqueness of the solution of 
( |2.112H2.113"1 )-( |2.114| . In fact > i f * e C^fO,^; L 2 (0,L)) fl C°([0,T]; i7 3 (0, L)) is 
the solution of 



5(i,0) = z(t,L) = z x (t,L) = 0, Vi e [0,T], 

d^< 
i(0,.x) = z T (L-a;), Va; e [0,L], 



then 



z{t,x) =z(T-t,L-x),V(t,x) G [0,T] x [0,L]. 



Now let u G C 2 ([0,T]) be such that w(0) = 0. Let 



be such that 
(2.153) 
(2.154) 
(2.155) 



2 /eC 1 ([0,T];L 2 (0,L))nC°([0,T];7J 3 (0,L)) 

Vt + Vx + Vxxx = 0, 

y(t,0) = y{t,L) = 0, y x {t,L) = u{t), Vt G [0,T], 
2/(0,-)=0. 
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(Again the existence of such a y is proved above.) Then, from (2.149), (2.1501 
(2.1511, (2.1531, (2.1541 and (2.155), we get, using integrations by parts, 



L pL 

z Tt{u)(1x = / z y(T,x)dx 

• i Jo 

T ,-L 

\ (zy) t dxdt 
n Jo 

T r L 

(zx + z xxx )y + z(y x + y XX x)dxdt 



z x (t, L)u(i)dt, 



which, since the set of u € C 2 ([0,T]) such that u(0) = is dense in L 2 (0,T), 



concludes the proof of Lemma |2.28| 



Let us now assume that L §t J\f and prove that the observability inequality 



(2.781 holds in this case. Replacing x by L — x and thy T — t and using Lemma 



2.28 one sees that observability inequality (2.781 is equivalent to the inequality 



(2.156) 



c\\y°\\mo,L) < IM-,o)|| L2(0 , T) , v y ° e v{A), 



with y(t, ■) := S(t)y°. We argue by contradiction and therefore assume that (2.156) 
does not hold whatever c > is. Then there exists a sequence (j/„) n eN of functions 
in T>{A) such that 

ll2/r°JU 2 (0,L) 



(2.157) 



Un 



1, Vn e 



■, 0) -> in L 2 (0, T)asrn +oo, 



S(t)j/°. By (2.141) and (2.1571 



(2.158) 

with y„(t,- 

(2.159) the sequence (y n )n£N is bounded in L ((0,T);H (0,L)) 

Moreover, since y nt 

(2.160) 



-!Jn 



Vn 



(2.1591 implies that 
the sequence {y n t)n&H is bounded in L ((0,T); H~ (0,1/)). 



Let us recall the following compactness result |21J due to Jean-Pierre Aubin (see 
also the paper 449] by Jacques Simon for more general results). 

Theorem 2.29. Let X , B , Y be three Banach spaces such that 

X C B C Y with compact embedding X ■— > B. 

Let T > 0. Let K be a bounded subset o/L 2 ((0, T); X). We assume that there exists 
C > such that 

df 



Of 



< C, V/ € K. 

L 2 ((0,T);Y) 

Then K is relatively compact in L 2 ((0,T); B). 

We apply this theorem with X := 7^(0, L), B := L 2 (0,L), Y := g~ 2 (0,L) 



and K := {y n ; n E N} . By ( |2.159[ ) and ( |2.160[ ), the assumptions of Theorem [239 
hold. From this theorem, one gets that the set {y n ; n S N} is relatively compact 



I(i 
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in L 2 ((0, T); L 2 (0, L)). Hence, without loss of generality, we can assume that, for 
some ye L 2 ((0, T); L 2 (0, L)), 

(2.161) y n -> y in L 2 ((0, T); L 2 (0, L)) as n 



+00. 



From (2.142), (2.1581 and (2.161) applied to y n — y m , we get that (?/°)n6N is a 
Cauchy sequence in L 2 (0, L). Hence there exists y° G L 2 (0, L) such that 



(2.162) 



.'/„ 



Clearly, from ( |2.16l| and (|2_162j) 
(2.163) 



By ( |2.157| and (|2_162j), 
(2.164) 

By the continuity of the map 
z° eL 2 {0,L) 



y in L (0, L) as n —> 00. 
y(t,-) = S(t)y°. 

\\y°h*(o,L) = 1. 
>(i^(^(i)z°) ;c (0))eL 2 (0,T) 



(see (2.1401), (2.158), (2.162) and (2.1631, 



(2.165) 



y:c (-,0) = 0inL 2 (0,T). 



Finally (2.163), (2.164) and (2.1651 are in contradiction with the following lemma. 



Lemm a 2.30 Let T > and let y° e L 2 (0,L) such that \2.165\ holds for y 
defined by \2.16S/\f. Lf L g N ', then y° = 0. 



Proof of Lemma 2.30 



One uses a method due to Claude Bardos, Gilles 
Lebeau and Jeffrey Rauch [511 page 1063]. Let T > 0. For T' > 0, let N T > be the 
set of y° G L 2 (0 L) su c h tha t if y G C°([0, +00); L 2 (0, L)) is the solution of the 
Cauchy problem ( |2.96[ )-( |2.97| -( |2.98| with u := 0, then 

y:c (-,0) = 0inL 2 (0,T'). 

Clearly 

(2.166) (0 < T < T") => (N T " C N T ,). 



Of course, due to (2.140), for every X" > 0, N? 1 is a closed linear subspace of 
L 2 (0,L). Let us prove that 

(2.167) for every T > 0, the vector space Nt> is of finite dimension. 

Let T" > and let (2/^) n eN be a sequence of elements in Nx> such that ||y„||i2(o,i,) = 
1. The same proof as for (2.162) gives us that one can extract from (j/„)«eN a 
subsequence converging in L z (0, L). Hence the unit ball of Nt> is compact. This 
proves (2.1671. 



From (2.1661 and (2.1671 and an argument of cardinality, there exist T" > 
and rj > such that T' + r\ < T and 

(2.168) N T , +t = N T ,,Vt€[0,ri]. 
Let 

(2.169) M:={f:te [0,r,/2] .- 5(t)y°; z 7 ° € AW C C ([0,r7/2]; L 2 (0,L)). 



Note that, by (2.1671, A/ is a vector space of finite dimension, which implies that 
(2.170) M is a closed subspace of L 2 ((0,r;/2); H' 2 {0, Lj). 
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Let y° e N T >. Since S(T)S(t)y° = S(t + t)y°, we get from J2.168| ), 
(2.171) S(t)y o eJV T ',Vte[0,»7]. 

Let y G C°([0,?7];L 2 (0,L)) be denned by 

y(t,-) = S(t)y°. 
Since y G H x ((Q,rf);H- 2 (0,L)), there exists z G L 2 ((0,r?/2); 7J^ 2 (0, L)) such that 



(2.172) 



Km 

£-.0 + 



y{e + 



»(•••) 



zmL 2 ((0,77/2);#- 2 (0,L)). 



By (2.1691 and (2.171), 



(2.173) 



r G [0,77/2] h-> yJ^±lA y ^ T '^ \ e M , Ve G [0,77/2]. 



By fl2.170| , ( |2.172| and ( |2.173[ ), 

2; g M, 

which implies that G C°([0, 77/2]; L 2 (0, L)) and z(0) 6 AT T ,. Hence 

j/GC 1 ([0,r / /2];L 2 (0,L)). 



Therefore, using ( |2.163| , j/ G C°([0,ji/2], 7J 3 (0, L)) and y° is such that 

(2.174) y°€H 3 (0,L), 

(2.175) p°(0) = y°(0) = y°(L) = y°(L) = 0, 

(2.176) Ay = z(0) e N T , . 

Hence one can define a unique C-linear map A : CNt> — > CNt> by requiring 
.A(^) = CA/?, VC eC,Vj)e 7V T ,. 



Then (see also ( 2. 167 1) , if Nt> 7^ {0}, this linear map has an eigenvector. Hence 
Lemma 2.30 is a consequence of (2.166) and of the following lemma. 

Lemma 2.31 ( |407> Lemma 3.5, page 45]). There exist A G C and 

^Gi7 3 ((0,L);C)\{0} 



such that 

(2.177) 
(2.178) 

if and only if 



~fx - Vxxx = A<£, 

¥>(0) = <p x (0) = ip(L) = <p x {L) = 0, 
LeAf. 



One can prove Lemma |2.31| by looking at the Fourier transform of ip extended 
to M. by outside [0, L]; see [407, pages 45-46] for a detailed proof. This concludes 
the proof of Lemma |2.30| and the proof of the "if" part of Theorem |2. 25 1 on page|42| 



l.s 
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Let us now assume that 
(2.179) 



LeM 



and prove that the control system (2.94 I- (2. 95 I is not controllable in time T > 



whatever T > is. By (2.1791 and by Lemma 2.31 there exist A G C and <p G 
H 3 ((0,L);£) such that ( |2.177| and ( |2.178| ) hold and 

(2.180) <^/0. 

Let (y m) £ C°([0,T];L 2 (0, L)) x L 2 (0, T) be a trajectory of the control system 
( |2.94| -( |2.95| . Let us first assume that y(0, •) G ©(A) and u G C 2 ([0, L1) sa tisfies 
u(0)=0. Theny e (7 1 ([0,T];L 2 (0,L))nC*([0,T]^D(A)). We multiply fl2.94| by <p 
and integrate on [0,L]. Using (2.95), ( 2.177[ ) and (2.178) and integrations by parts, 
one gets 

d f L f L 

(2.181) — / yipdx = — A / yipdx. 

dt ./n ./n 



An easy density argument shows that (2.181 ) also holds if y(0, •) is only in L 2 (0, L) 
and u is any function in L 2 (0,T). From (2.181 1, one gets 

fL fL 

(2.182) / y(T,x)Lp{x)dx = e~ XT y{0,x)f{x)dx, 



which, together with (2.180), shows that ( 2.94 l-( 2.95 ) is not controllable in time 



T > 0. This concludes the proof of Theorem 2.25|on page [42 



Remark 2.32. Let us point out that, if A e C and ip e H 3 ((0,L);C) are such 



that ( |2.177| , ( |2.178| and ( |2.180[ ) hold, then 
(2.183) XeiM. 



Indeed, straightforward integrations by parts together with (2.178) give 

fL fL fL 

(2.184) / Tpip x dx = — ipTp x dx = i^s I ip~ip x dx, 



(2.185) 



ffixxxdx 



fPxxx dx = & tPVxxxdx, 



where, for zGC, 9z denotes the imaginary part of z and z the complex conjugate 



of z. We multiply ( |2.177[ ) by Tp and integrate on [0,X]. Using ( |2.184[ ) and ( |2.185 l 
we get 



(2.186) 



A / (ptpdx 
'a 



-i<s 



' ' H>Wx 



i fixxx)U'3C- 



From (2.1801 and (2.1861, we get (2.1831. 



Remark 2.33. Let us fix L e (0,+oo) \Af and T > 0. Let y° £ L 2 (0,L) 
and let y 1 6 L 2 (0,L). Let U be the set of u G L 2 (0,T) such that the solution 
y G C°([0, T]; L 2 (0, L)) of the Cauchy problem 

Vt + Vx + Vxxx = 0, (t, x) G (0, T) x (0, L), 
y{t 7 0) = y(t, L) = 0, y B (t, L) = u(t), t G (0, T), 

y(0,x) = ? / (x), a :e(0,L), 
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satisfies 

y{T,x)=y 1 {x) 7 x£ (0,L). 
Clearly U is a closed affine subspace of L 2 (0,T). By Theorem 
is not empty. Hence there exists a unique u = u y o y i e U such that 

u £ U and ||w||l2 (0iT) = inf{||u|| L 2 (0iT) ; u e U}. 



2.25 



on page 



42 



U 



By the proof of Theorem 2.25 



on page 



42 there exists C > (depending on T > 



and L > but not on y° ! L (0, L) and j/ 1 G L 2 (0, L)) such that 
(2.187) || v,„i ll^(o,L) < G(ll2/°ll^(o,L) + Ibl^tcL)). 

Straightforward arguments show that the map (y°,y l ) G L 2 (0,L) 2 
L (0,T) is linear and therefore, by (2.187), continuous. 



!-> UyOyl g 



Exercise 2.34. Lei L > and T > 0. VFe consider the following linear control 
system 



(2.188) 

(2.189) 

where, at time t G [0, T], i/ie siaie is y(t, ■) € L 2 (0,L) and i/ie control is u(t) £ 



w + y*+ / y(t,«)d» = o,te(o,T),*e (o,L), 

Jo 

v(t,o)=u(t),te(p,T), 



1. Check that, if y £ C^QO,! 1 ] x [0,L]) satisfies \2. 18ty - (2J8ty , then, for 
every r € [0, T] and for every <f> G C ([0,r] X [0,L]) such that 



(2.190) 



0(t,i) = O,Vt€ [0,r], 



one /ias 



(2.191) -/ / (4>t + 4> x - I 4>{t,s)ds)ydxdt- I u(t)</>(t,0)dt 

L ,-L 

y(r,x)(f>(T,x)dx — / y°(x)<fr(0,x)dx = 0, 
o Jo 

withy°(x) :=y(0,x), Vi€ [0,X]. 
2. Let A : T>(A) C L 2 (0,L) — > L 2 (0,L) 6e i/ie linear (unbounded) operator on 
L 2 (0,L) defined by 

V(A):={y£H 1 (0,L);y(0)=0}, 



(2.192) 
(2.193) 



Ay 



-2/x 



y{s)ds. 



2. a. Prove that A is a closed operator (Definition A.l 



a dissipative operator (Definition A. 2 



on page 



on page 



373) and 



373). 



2.b. Compute the adjoint A* of A. Check that A* is also a dissipative 
operator. 
3. Well-posedness of the Cauchy problem. Let u € L 2 (0,T) and y° € 
L 2 (0,L). Until the end of this exercise one says that y : (0,T) x (0, Li) — > R 
is a solution of the Cauchy problem 



(2.194) 

(2.195) 
(2.196) 



yt + Vx + / y(t, s)ds = 0, t € (0, T), x e (o, L), 

Jo 

i/(t,o) = u(t),te(o,r), 

2/(0,x) = 2 / (x), 2 :e(0,L), 



r,n 
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) holds, for every r S [0,T] and for 

has at 



ifyeC°([0,T];L 2 (0,L)) and if (2.191 



2.190). 



every <f> € C 1 ([0,r] x [0, L]) satisfying ( 
3. a. Prove that the Cauchy problem (2.1 9$ , {2.195^ and (2J 
least one solution 



3.b. Prove that the Cauchy problem (2.194), (2.195) and (2.196) has at 

most one solution. 

4- Expression of the adjoint. Let us define a linear map Tf : L 2 (0,T) — > 

L 2 (0,L) in the following way. Letu 6 L 2 (0,T) L ety € C °([0, T]; L 2 ( 0, L)) 

be the solution of the Cauchy problem (2.194), (2.195) and (2.196) with 



0. Then 



F T (u):=y(T,-). 



Compute T?p. 
5. Observability inequality. In this question, we assume that u = 0. 

5. a. Prove that, for every y° G L 2 (0,L), the solution y of the Cauchy 
problem \2. 194% l[2.195\ ) and (2.196\ ) satisfies 

y(-,L)eL 2 (0,T). 

5.b. We now assume that T > L. Prove that there exists C± > such 
that, for every y° € L 2 (0,L), the solution y of the Cauchy problem 



(2.197) 



(2.194), (2.195) and (2.196) satisfies 



ll»°lli»(o t L)<C' 1 ||||,(. > L)||i, (0iT) 




y(t, x)dx dt 



(Hint. Proceed as in the proof of (2.93): multiply (2.194) succes- 
sively by y and by (L — x)y and integrate on [0,L].j 
5.c. Prove that, if A € C and z € i7 1 ((0, L);C) are such that 



z x + I z(s)ds = Xz in L (0,L), 

'0 

z(P) = 0, 

then z = 0. 
5.d. We again assume that T > L. Prove that there exists C2 > such 
that, for every y° € L 2 (0,L), the solution y of the Cauchy problem 
( 2.194% (2.195] and (2.196\ ) satisfies 

\\y°\\L H0 ,L)^C 2 \\y(;L)\\ LH0tT) . 

Controllability. We again assume thatT > L. Prove the controllability of 
the control system (2.18S)-(2.189). More precisely, prove that there exists 
C3 > such that, for every f£L 2 (0,L) and for every y 1 £ L 2 (0,L), there 
exists u G L 2 (0,T) such that 

h\\mo,T)^C 3 (\\y°\\ LHoM + 1^11^(0^) 



and su ch that the solution y of the Cauchy problem (2.194), (2.195) and 
(2.196] satisfies y{T, ■) = y 1 in L 2 (0,L). 
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2.3. Abstract linear control systems 



Looking at Section [2. 1| and Section [2. 2[ one sees that some proofs for the trans- 
port equation and for the Korteweg-de Vries equation are quite similar. This is, for 
example, the case for the well-posedness of the associated Cauchy problems (com- 



pare Section 2.1.1 with Section 2.2.1 1. This is also the case for the fact that a suit- 



able observability ((2.781 for the transport equation and (2.156) for the Korteweg-de 



Vries equation) is equivalent to the controllability. The goal of this section is to 
present a general framework which includes as special cases the study of these 
equations and their controllability as well as many other equations. This general 
framework is now very classical. For pioneer papers, let us mention, in particular, 
[434] by Dietmar Salamon, [4991 1500] by George Weiss, and [I38 j by Ruth Cur- 
tain and George Weiss. For more recent references and more advanced results, let 
us mention, for example, 

- [491 Chapter 3] by Alain Bensoussan, Giuseppe Da Prato, Michel Delfour 
and Sanjoy Mitter, 

- [93 by Yacine Chitour and Emmanuel Trelat, 

- [280, Section 2.2] by Vilmos Komornik and Paola Loreti, 

- [302, Chapter 7] by Irena Lasiecka and Roberto Triggiani, 

- [412] by Lionel Rosier, 

- [462] Chapter 1 to Chapter 5] by Olof Staffans, 

- [486, Section 2.4.1] by Marius Tucsnak. 

Remark 2.35. Note, however, that, as it is often the case for partial differential 
equations, this general framework is far from being the "end of the story" . For 
example it gives the observability inequality that one needs to prove but does not 
provide any method to prove it. 

For two normed linear spaces Hi and H 2 , we denote by C(Hi; H%) the set of con- 
tinuous linear maps from H\ into H 2 and denote by || • \\c(h 1 ;H 2 ) the usual norm in 
this space. 

Let H and U be two Hilbert spaces. Just to simplify the notations, these 
Hilbert spaces are assumed to be real Hilbert spaces. The space H is the state 
space and the space U is the control space. We denote by (■, -)h the scalar product 
in H, by (■, -)u the scalar product in U , by || • \\h the norm in H and by || ■ \\u the 
norm in U. 

Let S(t), t G [0, +00), be a strongly continuous semigroup of continuous linear 

Let A be 



operators on H (see Definition A. 5 and Definition A. 6 



on page 



3741 



the infinitesimal generator of the semigroup S(t), t G [0, +00), (see Definition A. 9 
As usual, we denote by S(t)* the adjoint of S(t). Then S(t)*, t G 



375) 



on page 

[0, +00), is a strongly continuous semigroup of continuous linear operators and the 



infinitesimal generator of this semigroup is the adjoint A* of A (see Theorem A. 11 
on page 375 I. The domain D(A*) is equipped with the usual graph norm || • ||.d(A*) 



of the unbounded operator A*: 

WzWd^ := \\z\\ H + \\A*z\\ H7 \/z e D(A*). 
This norm is associated to the scalar product in D(A*) defined by 

(zi,z 2 ) D (A*) '■= (zi,z 2 ) H + (A*z 1 ,A*z 2 ) H , V(zi,z 2 ) G D(A*) 2 . 



:,2 
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With this scalar product, D(A*) is a Hilbert space. Let D(A*)' be the dual of 
D(A*) with the pivot space H. In particular, 

D(A*) C He D(A*)'. 

Let 

(2.198) BeC(U,D(A*)'). 

In other words, B is a linear map from U into the set of linear functions from D(A*) 
into R such that, for some C > 0, 

|(Bu)*| < q|«||u||«||u(A-)» V « et/,Vz€ D(A*). 

We also assume the following regularity property (also called admissibility condi- 
tion): 

(2.199) VT>0,3C7 T > such that / \\B*S(t)*z\\udt < C T \\z\\ 2 H , V* G D(A*). 

Jo 



In (2.199) and in the following, B* £ £(D(A*); U) is the adjoint of B. It follows 



from (2.1991 that the operators 

(z G D(A*)) -» ((t .-» B*S(t)*z) G C°([0,T]; [/)), 

(z G I>(A*)) .-> ((i .-> 5*S(T - t)*z) G C°([0, T]; 17)) 

can be extended in a unique way as continuous linear maps from H into L 2 ((0, T); [/). 
We use the same symbols to denote these extensions. 

Note that, using the fact that S(t)*, t G [0, +oo), is a strongly continuous 



semigroup of continuous linear operators on H, it is not hard to check that (2.199) 
is equivalent to 

3T > 0, 3C T > such that f \\B*S{t)*z\\%dt < C T \\z\\ 2 H , Vz G D{A*). 

Ja 

The control system we consider here is 
(2.200) y = Ay + Bu, te (0,T), 

where, at time t, the control is u(t) G U and the state is y(t) G H. 
The remaining part of this section is organized as follows: 

we study the well-posedness of the Cauchy problem asso- 



- In Section 2.3.1 



ciated to (2.2001 



In Section 2.3.2 



we study the controllability of the control system (2.2001 



We give the observability inequality which is equivalent to the controllabil- 



ity of (2.2001 



- Finally, in Section [2.3.3| we revisit the transport equation and the Korteweg- 
de Vries equation, studied above, in the framework of this abstract setting. 

2.3.1. Well-posedness of the Cauchy problem. Let T > 0, y° G H and 

U G i 2 ((0, T); U). We are interested in the Cauchy problem 

(2.201) y = Ay + Bu(t),te(0,T), 

(2.202) 2/(0) =y°. 



We first give the definition of a solution to (2.201 1-(2. 202). We mimic what we 



have done in Section |2.1.1| for a linear transport equation and in Section |2.2.1| for 
a linear Korteweg-de Vries equation. 
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Let t G [0,T] and tp : [0,r] -> ff. We take the scalar product in # of ( |2.201[ ) 
with tp and integrate on [0,r]. At least formally, we get, using an integration by 
parts together with (2.202), 

(y(r)Mr))H-(y°M0))H- f (y(t),<p(t) + A*<p(t)) H dt = f {u{t),B*<p(t))udt. 

Jo Jo 

Taking tp(t) = S(T — t)*z T , for every given z T G H , we have formally (p(t)+A*<p(t) = 
0, which leads to the following definition. 

Definition 2.36. L e t T > 0, y° G H and u G L 2 ((0,T); U). A solution of the 
Cauchy problem (2.20l\l-(2~202} is a function y £ C°([0, T];H) such that 



(2.203) 

(y(T),z T ) H -(y ,S(Tyz^ H 



J {u{t),B*S{T-tyz T )udt,\/Te [0,T], Vz T eff. 
Jo 



Note that, by the regularity property (2.1991, the right hand side of (2.203) is 
well defined (see page 52 I. 

With this definition one has the following theorem. 

Theorem 2.37. Let T > 0. Then, for every y 6 H and for every u € 
L 2 ((0,T); U), the Cauchy problem (2.201)-(2.202) has a unique solution y. More- 
over, there exists C = C{T) > 0, independent of y° G H and u G L 2 ((0,T);U), 
such that 



(2.204) 



Proof of Theorem 



\\y(r)\\ H < C(\\y°\\ H + ||«|| L »((o t D;to)> Vt e M- 

Let T > 0. Also let y Q G H and u G L 2 ((0, T); [/). 



2.37 



Then (see in particular the regularity property (2.199 l), for every r > 0, the linear 
form 



if 

z T 



(l/°, S(t)*Oh + f >, B*5(r - t)*z r )udt, 



is continuous. Therefore, by Riesz's theorem, there exists one and only one y T G if 
such that 



(2.205) 



(y r ,z T ) ff = (y°,S*(r)*z T ) ff + / (u,B*5(r - t)*z r )udt, Vz T e H. 

Jo 



This shows the uniqueness of the solution to the Cauchy problem (2.201 1-(2. 202 ). 
Concerning the existence of a solution satisfying (2.2041, let y : [0, T] — > H be 
defined by 



(2.206) 



|/(r)= 2 / T ,Vre[0,T]. 



From (|2.205|) and ( |2.206| , we get (|2_203j). By Theorem |A.8 
375 1 there exists C" > such that 



A. 11 



on page 



on page 



375 



and The- 



(2.207) 



\\S(t)*\\c(H;H)^C',Vte[0,T]. 



From ( |2.199| , ( |2.205| , ( |2.206| and (|2_207j), we get that 

\\y(r)\\ H < C'\\y \\ H + 4 /2 |kll^((o,T) if /), Vr G [0,T], 



which gives (2.2041 with C := Max {C'.C^ } 



1/2, 



51 
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It just remains to check that y € C ([0, T}; H). Let r G [0,T] and (T n )„ e N be 
a sequence of real numbers in [0, T] such that 

(2.208) t„ — > r as n — > +oo. 

Let z T £ H and let (/™) n gi be a sequence of elements in H such that 

(2.209) z T " — i - z T weakly in H as n — > +oo. 



From (2.2091, and since S'(i), £ € [0, +oo), is a strongly continuous (see Defini- 
tion 



A.6 



on page 



374 ) semigroup of continuous linear operators on H , 



(2.210) 
lim (y°,S(T n yz T ")„= lim (S(T n )y° , z T *) H = (S( T )y° , z T ) H = (y° , S(t)* z T ) H . 

n — >+oo n — >+oo 

We extend u to an element in L 2 ((— T, T); iJ) by requiring 

u(t) :=0,te (-T,0). 
Note that, letting s = r n — t, 

(2.211) f \u{t),B*S{T n -t)*z T -) u dt= f { X n(s)u(T n -s),B*S{s)*z T -) u d S , 
Jo Jo 



(2.212) / (M(t),S*S*(r-t)*^) [/ di= / (x(s)u(r-s),B*5(s)*z T )[/ds, 
Jo Jo 

where Xn : [0, T] — > K and x : [0, T] — > M are defined by 

(2.213) \n = 1 on [0,t„] and x« = outside [0,r„], 

(2.214) x = 1 on [0, r] and x = outside [0, r]. 



From (2.2081, (2.2131 and (2.214), one gets 



(2.215) 



Xn{-)u{r n - •) -> x(-) u ( T - •) in L 2 {{0,T);U) as n -» oo. 



From (2.1991 and (2.2091, one gets 



(2.216) 



B*S(-)*z Tn -> B*S{-)*z r weakly in L 2 ((0,T);C7) as n -> oo. 



(Let us recall that a continuous linear map between two Hilbert spaces is weakly 
continuous; see, for example, [711 Theoreme III. 9, page 39].) From (2.211), (2.2121, 
(12.215} and (12.216}, we have 



(2.217) 



lim 

n — > + oc 



(u, J B*S'(r„-^)*z T ") [/ (ii= / {u,B*S{T-t)*z T )udt. 
i] Jo 



From ( |2.205} , ( |2.210} and (|2_217j), one gets that 

{y{T n ),z Tn ) H -> {y{ T ),z T ) H asn-t +oo, 

which implies that 

2/(7"n) - * 2/(t) in 7J as n — > +00. 
This concludes the proof of Theorem |2.37| 
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2.3.2. Controllability and observability inequality. In this section we 



are interested in the controllability of the control system (2.200). In contrast to the 



case of linear finite-dimensional control systems, many types of controllability are 
possible and interesting. We define here three types of controllability. 



Definition 2.38. Let T > 0. The control system (2.200) is exactly controllable 



in time T if, for every y° £ H and for every y 1 £ H, there exists u £ £ 2 ((0, T); U) 
such that the solution y of the Cauchy problem 



y = Ay+Bu{t),y{0) = y° 



(2.218) 

satisfies y(T) = y . 

Definition 2.39. 

in time T if, for every y° £ H and for every y° £ H, there exists u £ L 2 ((0, T); U) 
such that the solution of the Cauchy problem (2.2181 satisfies y(T) = S(T)y°. 



Let T > 0. The control system (2.200) is null controllable 



Let us point out that, by linearity, we get an equivalent definition of "null 
controllable in time T" if, in Definition 2.39 one assumes that y° = 0. This 
explains the usual terminology "null controllability" . 



Definition 2.40. Let T > 0. The control system (2.200) is approximately 



controllable in time T if, for every y° £ H, for every y 1 £ H, and for every e > 0, 
there exists u £ L 2 ((0,T);C7) such that the solution y of the Cauchy problem (2.218) 
satisfies \\y{T) - y^ln ^ e. 

Clearly 

(exact controllability) 



(null controllability and approximate controllability). 



The converse is false in general (see, for example, the control system (2. 374)- (2. 375 ) 



below). However, the converse holds if S is a strongly continuous group of linear 

on page 



operators (see Definition A. 12 



376 and Definition A. 13 



on page 



376). More 



precisely, one has the following theorem. 

Theorem 2.41. Assume that S(t), t £ 
linear operators. Let T > 0. Assume that the control system (2.200) is null con- 



is a strongly continuous group of 



trollable in time T. Then the control system (2.200) is exactly controllable in time 



Proof of Theorem 2.41 



Let y ' £ H and y 1 £ H. From the null con- 
trollability assumption applied to the initial data y° — S(— T)y , there exists u £ 
L 2 ((0, T); U) such that the solution y of the Cauchy problem 

jj = Ay + Bu(t), y(0) = y° - S{-T)y\ 

satisfies 

(2.219) y(T) = 0. 

One easily sees that the solution y of the Cauchy problem 

y 

is given by 
(2.220) 



Ay + Bu(t),y(0) = y°, 

y(t)=y(t) + S(t-T)y\yte[0,T}. 



In particular, from (2.2191 and (2.220) 



V(T) = y 1 



,-,<> 
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This concludes the proof of Theorem |2.41| 



Let us now introduce some "optimal control maps" . Let us first deal with the 



case where the control system (2.200) is exactly controllable in time T. Then, for 
every y 1 , the set U T {y 1 ) of u eI 2 ((0,T); U) such that 

(y = Ay + Bu(t), 2/(0) = 0) => (y(T) = y 1 ) 

is nonempty. Clearly the set U (j/ ) is a closed affine subspace of L 2 ((0, T); U). 
Let us denote by U T (y 1 ) the projection of on this closed affine subspace, i.e., the 
element of U T (y 1 ) of the smallest L 2 ((0,T); f/)-norm. Then it is not hard to see 
that the map 



W 



H 



L 2 ((0,T);[/) 
W T (y 1 ) 



is a linear map. Moreover, using the closed graph theorem (see, for example, [419 
Theorem 2.15, page 50]) one readily checks that this linear map is continuous. 



Let us now deal with the case where the control system (2.2001 is null con- 
trollable in time T. Then, for every y°, the set Ut(jj°) of u € L 2 ((0,T); U) such 
that 

(y = Ay + Bu{t), y(0) = y°) => (j/(T) = 0) 

is nonempty. Clearly the set {7t(j/°) is a closed affine subspace of L 2 ((0,T); U). 
Let us denote by Uxiy ) the projection of on this closed affine subspace, i.e., the 
element of ?7t(z/ ) of the smallest L 2 ((0,T); {/)-norm. Then, again, it is not hard 
to see that the map 



U T : H 

y° 



L 2 ((0,T);U) 

U T (y°) 



is a continuous linear map. 

The main results of this section are the following ones. 



Theorem 2.42. Let T > 0. The control system (2.200) is exactly controllable 
in time T if and only if there exists c > such that 

(2.221) 



/ \\B* S{t)* z\%dt > c\\z\\ 2 H , Vz e D{A* 
Jo 



Moreover, if such a c > exists and if c T is the maximum of the set of c > such 



that (2.221) holds, one has 



(2.222) 



WW 



\C(H;L 2 ((0,T);U)) 



Theorem 2.43. The control system (2.200) is approximately controllable in 
time T if and only if, for every z G H , 

{B*S{-)*z = in L 2 ((0,T); U)) =>■ (z = 0). 



Theorem 2.44. Let T > 0. The control system (2.200) is null controllable in 
time T if and only if there exists c > such that 

(2.223) f \\B*S{tyz\\ldt^c\\S(Tyz\\ 2 H ,VzeD(A*). 

Jo 
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Moreover, if such a c > exists and if ct is the maximum of the set of c > such 

1 



that (2.223) holds, then 



(2.224) 



\\U 



T\\C(H;L 2 ((0,T);U)) 



lc T 



Theorem 2.45. Assume that, for every T > 0, the control system (2.200) is 



null controllable in time T. Then, for every T > 0, the control system (2.200) is 
approximately controllable in time T . 



Inequalities (2.221) and (2.2231 are usually called observability inequalities for 
the abstract linear control system y = Ay + Bu. 

Proof of Theorem |2.42| and Theorem 12.431 Let T > 0. Let us define a 
linear map T T ■ L 2 ((0,T);U) -> H in the following way. L et u G L 2 ((0,T); U). 
Let y G C°([0,T\;H) be the solution of the Cauchy problem (2.218| ) with y° := 0. 
Then 

^r(tt):=y(3V). 



One has the following lemma, the proof of which is similar to the proof of Lemma |2.15| 
on page [34] 



Lemma 2.46. The control system (2.200) is exactly controllable in time T if 



and only if Tt is onto. The control system (2.200) is approximately controllable in 
time T if and only if Tt{L 2 ((Q,T); U)) is dense in H. 

It is a classical result of functional analysis that J-~t{L 2 ((0,T);U)) is dense 
in H if and only if T^ is one-to-one (see, e.g., [419, Corollaries (b), page 94] 
or [711 Corollaire 11.17 (b), page 28]). Let us recall on the other hand that, by 
Proposition |2.16| on page |35| Tt is onto if and only if there exists c > such that 

||Jt(z t )|| l2((0iT);C/) > c\\?7\\ H , Vz T G H. 

Hence, the first part of Theorem |2 ,42| as well as Theorem |2.43| are a consequence of 
the following lemma. 

Lemma 2.47. For every z T G H, 

{^(z T )){t) = B*S{T-t)*z T . 

Let z T G D(A*). Let us also recall that D(A*) is dense 
" Let ue L 2 ((0,T);[/). Let y G C°([0,T];H) 



Proof of Lemma 

in H: see Theorem 



2.47 



A. 11 



on page 



375 



be the solution of the Cauchy problem 

y = Ay + Bu{t),y(0) = 0. 



By the definition of Tt and Definition |2.36| on page |53| 

(u, T T (z T )) L i mT)lU) = {T T u, z t ) h = (y(T),z T ) H = f (u, B*S(T - t)*z T ) u dt. 

Jo 

This concludes the proof of Lemma |2.47| and also the proof of the first part of 

Theorem 12.421 and Theorem 12.431 ■ 



Let us now turn to the second part of Theorem 2.42 i.e., equality (2.222 |. By 
the definition of c T and Lemma 12.471 



(2.225) 



\\T T (z T ) 



\L 2 ((0,T)-U) 



>cl^,Vz J Gff. 



58 



By Proposition 2.16 

map U : H -» L 2 ((0, T); £/) such that 

(2.226) 
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on page 



35 (2.225 ) implies the existence of a continuous linear 



T T U V X = y\ V G ff, 



(2.227) 



H^II,C(i/:L 2 ((0,T);[/)) ^ 



1 



From ( |2.226| , ( |2.227| and the definition of W T , one gets 

\\U T 



(2.228) 



<; 



i 



C(H;L 2 ((0,T);U)) 

V L- 

Finally, from the definition of U T , one has 

T T U T y l = y\ Vy 1 G H, 
which implies that 
(2.229) (^ T ^ T )L2((o,T);t/) = 11*1*, Vz T G if. 



From (2.2291, one has 



< \\^T zT hmO,T);U) \\ UT \\ C (H-Lmo,T)-l,, 

which, together with the definition of c and Lemma 2.47 gives that 



z T \\ H , \/z T G H, 



c T > 



1 



H^ \\C(H;L 2 ((0,T);U)) 



This concludes the proof of (2.222 I 



Proof of Theorem |2.44[ The key tool for the proof of Theorem |2.44| is 
the following lemma due to Ronald Douglas [148J and Szymon Dolecki and David 
Russell [1461 pages 194-195] and which will be proved later on. 

Lemma 2.48. Let Hi, H 2 and H 3 be three Hilbert spaces. Let C 2 be a continuous 
linear map from Hi into Hi and let C 3 be a densely defined closed linear operator 
from V{C 3 ) C H 3 into Hi. Then the two following properties are equivalent: 

(i) There exists M Js such that 

(2.230) \\C* 2 hi\\ H2 < M\\CZh x \\H» Mi G V(C* 3 ). 
(ii) One has the following inclusion: 

(2.231) C 2 (H 2 ) C C 3 (V(C 3 )). 



Moreover, if M Js is such that (2.230) holds, there exists a continuous linear map 
Ci from H 2 into H 3 such that 

(2.232) Ci(H 2 )cV(C 3 ),C 2 = C 3 Ci, 



(2.233) 



\Ci\ 



< M. 



\C(H 2 ;H 3 ) 

Remark 2.49. In fact, it is assumed in [148. that the linear operator C 3 is 
continuous from H 3 int H 2 . However, the proof given in [148] can be easily adapted 
to treat the case where C 3 is only a a densely defined closed linear operator. (See 
on page 



Definition A.l 



373 for the definition of a closed linear operator.) 



Let us apply Lemma [2 ,48| with the following spaces and maps. 
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- The spaces Hi, H 2 and H 3 are given by 

Hx := ff, ff 2 := H, H 3 := L 2 ((0, T); [/). 

- The linear map C 2 maps y° G H to y(T) G _£f, where 2/ G C°([0,T]; if) is 
the solution of the Cauchy problem 

y = Ay, i/(0) =2/°. 

In other words, 

(2.234) C2 = S(T). 

- The linear map C 3 maps u G L 2 ((0,T);£/) to y(T) G 7?, where 3/ G 
C ([0,T];_ff) is the solution of the Cauchy problem 

y = Ay + Bu(t),y (0)=0. 

In other words, 

(2.235) C 3 = T T - 

Note that C3, in this case, is a continuous linear operator from L 2 ((0, T); U) 



into -ff. (For an application with unbounded C3, see Remark 2.98 
page 



110) 



With these choices, the null controllability of the linear control system y 



Ay + Bu is equivalent to the inclusion (2.2311. Indeed, let us first assume that 
(2.231 1 holds and prove the null controllability. Let y° and y° be both in H . Let 
uW7?((0,T);U) be such that C 3 u = C 2 (y° - y°), i.e., T T u = S{T){y° - y°). Let 
y G C°([0, T]; H) be the solution of the Cauchy problem 

y = Ay+Bu{t),y{0) = y°. 

Then y = y\ + y 2 , where y\ G C°([0, T]; H) is the solution of the Cauchy problem 

yi = A Vl , yi (0)=y°, 

and where 2/2 G C°([0, T]; H) is the solution of the Cauchy problem 

2/2 = Ay 2 + Bu, 2/2(0) = 0. 

In particular, 

2/(T) = yi (T) + y 2 (T) = C 2 y° + C 3 u = S(T)y° + S(T)(y° - y°) = S(T)y°, 

which proves the null controllability. The proof of the converse is similar. 



Let us now interpret (2.230). Using Lemma 2.47 (2.2341 and (2.235), one gets 
that (|2.230| is equivalent to (|2.223[) with c = 1/NP. 



[2^81 



Finally, concerning equality (2.224), let us define, with the notations of Lemma 
U := -d G C(H,L 2 ((0,T);U)). 



One has 
(2.236) 

(2.237) 



((2/ = Ay + BUy°, 2/(0) = 2/°) => (y(T) = 0)), V2/ G F, 

ll^ll£(H:L 2 ((0,T) ; ;7)) ^ 



From (2.2361, (2.2371 and the definition oIUt, one has 

(2.238) 



\\Mt\\ C (H;L 2 ((Q,T);U)) 



€ 



C T 



(ill 
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It just remains to prove that 

(2.239) ll^rlU(H;Z,2((0,T);£/)) ^ 

From the definition oIIAt, one has 

(2.240) T T U T = -S{T), 



c T 



From (2.2401, one has, for every z G H, 

\\S(T)*z\\ 2 H = -{U*F*z,S(X)*z) H 

^ Wt\\c(H;L 2 ((0,T);U)) \\^T z \\l 2 ((0,T);U)\\S(T)*z\\h, 
which implies that 



(2.241) 



\ttz\ 



L 2 ((0,T);U) 



> 



\\U T \ 



-\\S(T)*z\\ H ,VzeH. 



C(H;L 2 ((0,T)-U)) 



Inequality (2.239) follows from rt2.241 ), the definition of ct and Lemma 2.47 This 



concludes the proof of Theorem |2. 44 assuming Lemma |2.48| 

Let us first prove that (ii) implies (i). So we assume 



Proof of Lemma 



2.48 



that (2.2311 holds. Let h 2 G H 2 . By (2.231), there exists one and only one h 3 G 
T){C 3 ), orthogonal to the kernel of C 3 , such that C 2 h 2 = C 3 h 3 . Let us denote by 
C\ : H 2 — * H 3 the map defined by Ci{h 2 ) '■= h 3 . It is not hard to check that C\ 



is linear. Moreover, by the construction of C\, (2.232) holds. Note that, for every 
h\ G V(C 3 ) C Hi and for every x G H 2 , 

(C^hi,x)H 3 = (hi,C 2 x) ffl 
(2.242) = (hi,C 3 Cix) Hl 

= (Clhi,Cix) H3 - 



Hence, if Ci is continuous, (2.232) implies (2.2301 with M := ||Ci||£(# 2; # 3 ). So 



let us check that C\ is continuous. By the closed graph theorem (see, for example, 
|419| Theorem 2.15, page 50]), it suffices to check that the graph of C\ is closed. 
Let (/i^neN, (^jjOneN) h 2 G H 2 and h 3 G H 3 be such that 



(2.243) 

(2.244) 
(2.245) 



h' 



h™ e H 2 , hi G H 3 , Vn G N, 

Kl = C x h r 2 \ Vn G N, 
h 2 in H 2 and h^ — > h 3 in H 3 as n 



From (2.2441, one has 



(2.246) 



C 2 hl = C3/13 1 , hi G Ker(C 3 )\ Vn G N. 



Letting n — > +00 in (2.246) and using (2.245), one gets (let us recall that C 3 is a 
closed operator) 

h 3 G V(C 3 ), C 2 h 2 = C 3 h 3 and h 3 G Ker(C 3 )-\ 

which tells us that h 3 = C\h 2 . This concludes the proof of the continuity of C\ 
and also the proof of (ii)=>-(i). 



Let us now prove the converse. Hence we assume that (2.2301 holds for some 
M > 0. Let us define a map K : C 3 (V(C 3 )) C H 3 -> H 2 by requiring that 

K{Cthi) = C^hi, V/ii G V{C%) c H x . 



The map K is well defined since, by (2.2301, 

(C3/11 = Cpn) =3> (C£(hi - hi) = 0) => (C 2 (hi - hi) = 0) => (C%hi = Cj/ti). 
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for every (hi, hi) G P(C|) x T>(C 3 ). Moreover, K is linear. The vector space 
C 3 (T>(C 3 )), which is a vector subspace of H 3 , is of course equipped with the norm 
of H 3 . Then K is also continuous since, by (2.230), 



\\K(C* 3 hi)\\ H2 = \\C;hi\\ H2 < M\\C* 3 hi\\ H3 , V/n G V(Cl) C Hi, 
which implies that K G C(C 3 (T>(C 3 ))\ H 2 ) and that 
(2-247) \\K\\ C {CU-D{C*));H 2 ) < M. 



By (2.2471, A' can be uniquely extended as a continuous linear map from C 3 (D(C 3 )) 



into -02- Then we extend K to a linear map from .f/3 into H2 by requiring that if 
vanishes on C£(V(C$)) ± . Clearly X G C(H 3 ; H 2 ) and 
(2-248) H^lk*,;*,) ^ M, 

(2.249) iTC| = C2. 



From (2.2491, one easily gets 

(2.250) K*(H 2 ) C V(C 3 ) and C 3 K* 



C 2 



which readily implies (2.2311. Note that, if we let C\ := K* , (2.232) follows from 



(2.2501, and (2.233) follows from (2.2481. This concludes the proof of Lemma 2.48 



Proof of Theorem |2.45| on page [57} Let y°eH,y 1 eH,T>0 and 
£ > 0. Since the semigroup S(t), t G [0,+oo), is strongly continuous, there exists 
•q G (0,T) such that 

(2.251) \\S(r,)y l -y l \\ H ^e, 



(see Definition A. 6 on page 374). Since the control system (2.2001 is null controllable 
in time 77, there exists u G L z ((0, r/); U) such that the solution y G C°([0,r]]; H) of 
the Cauchy problem 

t = Ay + Bu(t), t G (0, rj), y(0) = S(T - V )y°, 

satisfies 

(2.252) y{rj) = S{rf)y l . 

Let u G L 2 (0,T) be defined by 

u(t) = 0,te(0,T- V ), 

u(t) = u(t-T + ri), te (T-T),T). 

Let y G C ([0, T]; H) be the solution of the Cauchy problem 



Then 

(2.253) 

(2.254) 



y = Ay + Bu(t),te(0,T),y(0)=y°. 

y(t) = S(t)v°,Vte[0,T-rj\, 

y(t)=y(t-T + V ),Vte[T-r 1 ,T}. 



From (2.2511, (2.2521 and (2.254), one gets 



\\y(T)-y l \\ H ^e. 
This concludes the proof of Theorem |2.45| on page [57] 



1.2 
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Remark 2.50. In contrast to Theorem |2.45[ note that, for a given T > 0, the 
null controllability in time T does not imply the approximate controllability in time 
T. For example, let L > and let us take H := L 2 (0, L) and U := {0}. We consider 
the linear control system 



(2.255) 
(2.256) 



y t + y x = 0,te{0,T) 7 xe (0,L), 
y (t,0) = u{t) = 0,te{0,T). 



In Section 2.3.3.1 we shall see how to put this control system in the abstract 
■ Bu; see also Section 



framework ij = Ay - 



2.1 



y £ L (0, L) is, the solution to the Cauchy problem (see Definition 



It follows from (|2.29|, that, whatever 

25 



and Section 2.3.3.1) 



2.1 



on page 



satisfies 



yt + y x = o, te(o,T), xe (o,i), 
y(t,0)=u(t) = 0,t€(0,T), 

y(0,x) = y°(x),xe(0,L) } 
y(T,-) = 0, HT^L. 



In particular, if T ^ L, the linear control system (2.255 l-( 2.256 I is null controllable 
but is not approximately controllable. 



2.3.3. Examples. In this section we show how the abstract setting just pre- 
sented can be applied to the two partial differential control systems we have encoun- 
tered, namely a transport linear equation and a linear Korteweg-de Vries equation. 

2.3.3.1. The transport equation revisited. We return to the transport control 
system that we have already considered in Section |2.1| Let L > 0. The linear 
control system we study is 



(2.257) 
(2.258) 



yt + y x = 0,te(0,T),x& (0,L), 
y(t,0)=u(t),t€(0,T), 



where, at time t, the control is u(t) € K and the state is y(t, ■) : (0, L) — > M. 

For the Hilbert space H, we take H := L 2 (0, L). For the operator A : D(A) 
H we take (as in Section 



2.1 



see (2.321 and (2.33 l) 



V(A):={feH\0,L);f(0) 
Af := -f x , V/ G V(A). 



0}, 



Then T>(A) is dense in L 2 (0, L), A is closed, A is dissipative (see (2.36 1) 
adjoint A* of A is defined by 

{feH 1 (0,L);f(L) = 0} 7 



The 



V(A* 



A*f := f x , V/ e V(A* 



By ( 2.3T I , the operator A* is also dissipative. Hence, by Theorem A. 10 



on page 



375 



the operator A is the infinitesimal generator of a strongly continuous semigroup 
5(i), t € [0,+oo), of continuous linear operators on H. 

For the Hilbert space U, we take U := K. The operator B : K -> D(A*)' is 
defined by 



(2.259) 



(B«)z = wz(0), Vu e K,Vz e £>(^4*). 
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Note that B* : D(A* 



is defined by 
B*z = z{0), Vze D(A*). 



Let us check the regularity property (2.1991. Let z° € D(A*). Let 



z€C°([0,T\;D(A*))nC l ([0,T\;L 2 (0,L)) 



be defined by z(t, •) = S(t)*z°. Inequality (2.199) is equivalent to 



(2.260) / z(t,0) 2 dt^C T z°{x) 2 dx. 
Ja Ja 

Let us prove this inequality for Ct '■= 1. We have 

(2.261) z t = z x ,te{0,T),xe{0,L), 



(2.262) 
(2.263) 



z(i,L) = 0, i€(0,T), 
2(0, x) = z°{x), xe (0,L). 



We multiply ( |2.261[ ) by z and integrate on [0, T] X [0, L\. Using ( |2.262| , ( |2.263[ ) and 
integrations by parts, we get 



(2.264) 



T ^.L 

z(t,0) 2 dt = / z°(a;) 2 da;- / 2(T» 2 d:r ^ / z"(x) 2 dx, 
ii Jo Jo Jo 



2j„ ^ / „0/„,\2, 



which shows that (2.2601 holds for Ct '■= 1 



Note that there is a point which needs to be clarified: we have now two defini- 
tions of a solution to the Cauchy problem 



(2.265) 
(2.266) 
(2.267) 



y t + y x = o,te{o,T) 7 xe (o,L), 

y(t,0) = u(t), 

y(0,x) = y a (x),xe(0,L), 



where T is given in (0, +oo), y° is given in L 2 (0, L) and u is given in L 2 (0, T). The 
first definition is the one given in Definition |2.1| on page |25| The second one is 

on page 



the one given in Definition 2.36 



53 (In fact, for the moment, there is no 



evidence that there exists any connection between "y is a solution in the sense of 



Definition 2.36' and y satisfies, in some "reasonable sense", (2.265), (2.266) and 



(2.2671.) Let us prove that these two definitions actually lead to the same solution. 
Let T be given in (0,+oo), y° be given in L 2 (0, L) and u be given in L 2 (0, T) 
Let y G C([0, T]; L 2 (0, L)) be a solution in the sense of Definition 2.1 on page|25| 



In order to prove that y is a solution in the sense of Definition |2.36| on page |53| it 
suffices to check that, for every r G [0, T] and every z T G £ 2 (0, L), 



(2.268) 



y(r, x)z T {x)dx 



y°(x)z(T, x)dx = I u(t)z(r — t,0)dt, 
ii Jo 



where z(t, ■) := S(t)* z T . By density of D(A*) in L 2 (0, L) and the continuity of the 
left and the right hand sides of (2.268 I with respect to z T for the £ 2 (0, L)-topology, 
it suffices to check that (2.2681 holds for every r € [0,T] and every z T e D{A*). 



(>i 
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Let t G [0, r] and z T G £>(A*). Then we have 

(2.269) z G C°([0, T]; iT^O, L)) n C x ([0, T]; L 2 (0, Z,)), 

(2.270) « t -^.=0 l t€(0 i r) J xG(0,L), 

(2.271) z(i,L) = 0,iG(0,r), 

(2.272) 2(0, x) = z T {x), xe (0, L). 



Let us point out that, by density and continuity arguments, (2.8) holds for ev- 
ery (f> G C q ([{),t\-H 1 (<),L)) n ^([O,"/-];!/ 2 ^)) satisfying ffil We take G 
C°([0,T];ff 1 (0,L))nC ,1 ([0,T];L 2 (0,L)) defined by 



(2.273) 



0(i,x) = z(t - £,#), i G (0,r), cc G (0,L). 



from (2.2701 and (2.273), one gets 



Note that, by (2.271) and (2.2731, (2.7) holds. Hence we have (2.8|. Moreover 



(2.274) 



o, te (o,t), x e (o,L). 



From (|2_8|) and ( |2.274| , we have 

u(t)4>(t,0)dt+ / y[T,x)4>yT,x)dx 



y°{x)<t>{0,x)dx = 0, 



which, together with (2.272) and (2.2731, gives (2.2681 



Let us deal with the converse, that is: Prove that every solution in the sense 



of Definition |2.36| on page [53] is a solution in the sense of Definition |2 . 1 1 on page [25] 
Note that in fact this follows from what we have just proved (a solution in the sense 
of Definition 



2.1 



is a solution in the sense of Definition 2.36 I, the uniqueness of the 



solution to the Cauchy problem in the sense of Definition |2.36| and the existence 
of the solution to the Cauchy problem in the sense of Definition |2.1[ Let us give a 
direct proof. Let T > 0, u G L 2 (0,T), y° GL 2 (0,L). Let y G C°([0, T]; L 2 (0, L)) be 



2.36 



a solution of the Cauchy problem (2.265 l-( 2.266 )-( 2.267 1 in the sense of Definition 



Let r G [0, T\. Let <j) G C^QO, r] x [0, L}) be such that §L7j holds. We want to 
prove that (|2 .8h holds. By density and continuity arguments we may assume that 



<j) G C 2 ([0,t] x [0,1,]). Let / G C-^t] x [0,1,]) be defined by 

(2.275) f(t,x) = -Mr-t,x)-^ x (r-t,x),\/te [0,r],Vi£ [0,L]. 

Let ae C 1 ([0,T];L 2 (0,L))nC°([0,T]; J D(A*)) be defined by 



(2.276) a(t,-):= S(t - s)*f(s,-)ds. 

Jo 

Let be C 1 ([0,T];L 2 (0,L))nC7°([0,r]; J D(^*)) be defined by 

(2.277) b(t,x) = 4>{T-t,x) -a(t,x), Vt G [0,r], Va; G [0,L]. 
One easily checks that 

(2.278) 6(t,-) = 5(t)*0(T,-),Vte[O,T]. 



From ([2_203j and ( |2.278| , we have 

(2.279) / 

Jo 



j/(r, x)4>(t, x)dx 



y (x)b(r, x)dx 



u(t)b(T-t,0)dt. 
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Let f(t) := f(t, •), t G [0,t\. From ( |2.203| > we have, for every t G [0,t], 
(2.280) / y(t,x)f(r-t,x)dx = / y°S(t)*f(T-t)dx 



+ / u{s)B*S{t-s)*f{T-t)ds. 



Integrating (2.2801 on [0,r] and using Fubini's theorem together with (2.2761, we 
get 

pt pL pL pT 

(2.281) / / y(t,x)f(T-t,x)dxdt= / y°a{r,x)dx + / u(t)o(r - 1, 0)dt. 
Jo Jo Jo Jo 



From fl2.275| , ( |2.277| , ( |2.279[ ) and ( |2.28l| , we get (|2.8 |. This concludes the proof 
of the equivalence of Definition |2.1| and Definition |2.36 



Let us now turn to the observability inequality (2.221 ) for exact controllability 
(a controllability type which was simply called "controllability" in Section 2.1 1. 
This inequality, with the above notation, reads 

(2.282) / z{t,0) 2 dt^c z°{x) 2 dx, 

Jo Jo 

where c > is independent of z° G D(A*) and where z(t, ■) = S(t)* z . The change 

of function z(t,x) := z(T — t,x) shows that inequality (2.282) is equivalent to 

inequality (2.87). 



Remark 2.51. Note that the regularity property (2.260) was also already 
proved in Section 2.1.1 see equality (2.431, which, with the change of function 
z(t,x) := y(t,L — x), gives (2.264) and therefore (2.2601. The key estimates (reg- 
ularity property and observability inequality) remain the same with the two ap- 
proaches. 

2.3.3.2. The Korteweg-de Vries equation revisited. We return to the Korteweg- 
de Vries control system that we have already considered in Section [2.2| Let L > 0. 
The linear control system we study is 

(2.283) y t + y x + y xxx = 0, t G (0,T), x G (0, L), 

(2.284) y(t, 0) = y(t, L) = 0, y x (t, L) = u(t), t G (0, T), 

where, at time t, the control is u(t) G K and the state is y(t, ■) : (0, L) — > M. 

For the Hilbert space H , we take H = L 2 (0, L). For the operator A : D{A) — > 
H, we take (as in Section 2.1 see (2.106) and ( 2.107 1) 

V(A) := {/ G H 3 (0,L); /(0) = f(L) = f x (L) = 0}, 

Af := -f x - f xxx , V/ G V{A). 

Then T>(A) is dense in L 2 (0,L), A is closed, A is dissipative (see (2.110)). The 
adjoint A* of A is defined by 

V(A*) := {/ G H 3 (0,L); /(0) = f(L) = f x (0) = 0}, 

A*f := f x + /«, V/ G V{A*). 



By (2.111 ), the operator A* is also dissipative. Hence, by Theorem A. 4 



on page 



374 



the operator A is the infinitesimal generator of a strongly continuous semigroup 
S(t), t G [0,+oo), of continuous linear operators on £ 2 (0, L). 



m 
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R. The operator B 



For the Hilbert space U, we take U 
defined by 



D{A*Y is 



(2.285) (Bu)z = uz x (L), Vu G R,Vz G D(A*). 
Note that B* : D(A*) -» R is defined by 

B*z = z x {L), Vz G D{A*). 

Let us check the regularity property (also called admissibility condition) (2.1991. 
Let z° G D{A*). Let 

zeC°([0,T];^(^))nC 1 ([0,T];L 2 (0,L)) 

be defined by 

(2.286) z(t,-) = S(t)*z°. 



The regularity property (2.1991 is equivalent to 

(2.287) f \z x {t,L)\ 2 dt^C T f \z°(x)\ 2 dx. 



From (2.2861, one has 

(2.288) z t -z x - z xxx = in C°([0, +oo); L 2 (0, L)), 

(2.289) z(i, 0) = z x (t, 0) = z(<, L) = 0, t G [0, +oo), 

(2.290) z(0,x) = z°(x),xG[0,L]. 

Let ye C°([0,T]; J ff 3 (0,L))nC 1 ([0,T]; J L 2 (0,L)) be defined by 

(2.291) y(t, x) = z(t, L-x), (t, x) G [0, T] x [0, L]. 



From ( |2.288| , (|2.289|, (|2.290| and (|2.29l}, one has 
(2.292) 



(2.293) 



Vt + Vx + y xxx = in C°([0, r]; L 2 (0, L)), 
2/ (i,L) = y rc (t,L)= y (i,0)=0, te [0,T]. 



Hence, for every r G [0,T], we have (2.119) with u = 0. In particular, taking t = T, 
one has 



(2.294) f \y x (t,0)\ 2 dt= I \y° (x)\ 2 dx - [ \y(T lX )\ 2 dx < f \y°(x)\ 
Jo JO JO Jo 

From (12.291} and (12.294}, one gets (12.287} with C T := 1. 



l dx. 



Let us now turn to the observability inequality (2.221 1 for the exact controllabil- 
ity (a controllability type which was simply called "controllability" in Section 2.2 I. 
In the case of our Korteweg-de Vries control system, this observability inequality 
reads 

(2.295) / \z x {t,L)\ 2 dx^ c \z{0,x)\ 2 dx, 



for every z£ C°([0, T]; H 3 (0, L))nC 1 ([0, T]; L 2 (0, L)) satisfy ing J2 288} and ( |2.289[ ). 
Defin ing y G C°([0,T];H 3 (0,L)) n C^([0, T];X 2 (0,X)) by ( |2.291} , one easily sees 
that (2.2951 is indeed equivalent to (2.156). 

Hence, again, the key estimates (regularity property and observability inequal- 
ity) remain the same with the two approaches. 
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It remains to check that the two notions of solutions to the Cauchy problem 

Vt + Vx + Vxxx = 0, t G (0,T), xe (0,L), 

y(t, 0) = y(t, L) = 0, y x (t, L) = u{t), t G (0, T), 

y(0,x)=y°(x),x€(0,L), 



i.e., the one given by Definition |2.36| on page |53| and the other given in Definition |2.21| 
on page |38[ lead to the same solutions. This fact can be checked by proceeding as 



for the transport equation (see page 63 I 



2.4. Wave equation 

Let L > 0, T > and a G L°°((0,T) x (0,L)). We consider the linear control 
system 

(2.296) y u - y xx + a{t, x)y = 0, t € (0, T), x G (0, L), 

(2.297) y(t, 0) = 0, y x (t, L) = u(t), t G (0, T), 

where, at time t G (0,T), the control is u(t) G K and the state is 

(y(i,-),2/ t (i,-)):(0,£)^K 2 . 

2.4.1. Well-posedness of the Cauchy problem. Let us first give a natural 
definition of solutions of the Cauchy problem 



(2.298) 
(2.299) 
(2.300) 



yu - yxx + a(t, x)y = 0, t G (0, T), x G (0, L), 

y(t,0) = 0,i/ a (t,L) = tt(t),*e(0,T). 

y(0, x) = a°(cc), yt(0,a;) = 0°(x), x G (0,L), 



where a Gff^CO.L) := {a G ff x (0,L); a(0) = 0}, /3° eL 2 (0,I) andwGL 2 (0,T) 
are given. The vector space H} Q J0,L) is equipped with the scalar product 

(ai,a 2 ) ff i o) ( ,L) : = / a lx a 2x dx. 

With this scalar product, H} Q J0,L) is a Hilbert space. In order to motivate 
Definition |2.52| below, let us first assume that there exists a function y of class 
C 2 on [0,T] x [0,L] satisfying ( |2.298| to ( |2.300| in the usual sense. Let <f> G 
C l ([0,T] x [0,X]) be such that 



(2.301) 



0(t,O) =0, ViG [0,T]. 



We multiply (2.2981 by and integrate the obtained equality on [0,r] x [0,L], with 
re [0,1 

(2.302) 



t G [0,T]. Using ( |2.299[ ), ( |2.300[ >, ( |2.301| and integrations by parts, one gets 



y t (r,x)(j)(T,x)dx — / /3 (a;)(/)(0,x)dx 

i] Jo 

(<^t2/t - 4>xVx ~ a<fiy)dxdt - / u(t)<f>(t, L)dt = 0. 
o Jo Jo 

This equality leads to the following definition. 
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Definition 2.52. Let T > 0, a G H} Q) (0,L), (3° e L 2 {0,L) and u G L 2 (0,T) 
be given. A solution of the Cauchy problem (2.298)-(2.299)-(2.300) is a function 
y G L°°((0,T);ffL(0,L)) such that y t G L°°((0,T); L^OTX)), satisfying 



*(o)v 



(2.303) 
(2.304) 



J/(0,-) = a°, 

i/(t,o) = o,vte[o,r], 



and such that, for every e C 1 ([0,T\ x [0,£]) satisfying ( |2.30l| ), one has J2.302| ) 

for almost every r G (0,T). 

With this definition, one has the following theorem. 

Theorem 2.53. Let T > 0, L > and R>0. There exists C := C(T, L,R) > 
smc/i i/iai, /or every a G L°°((0,T) x (0,L)) satisfying 



(2.305) 



||o|U~((0,T)x(0,i)) ^ R> 



for every a G H} Q J0, L), for every /3 G L 2 (0,L) and /or every u G L 2 (0,T), 
i/ie Cauchy problem \ '2. 298\ )-( 2. 299)- [ 2. 300 ) has a unique solution and this solution 
satisfies 

(2.306) \\y\\L°°((p,T);Hi 0) (p,L)) + ll2/t||L~((0,T);L 2 (0,L)) 

< C(\\a°\\ Hlo)(0tL) + \W°\\mo,L) + hh H o,T))- 
Moreover, y(;L) G L°°(0,T) is in fact in H l (0,T) and 

(2.307) \\y t (;L)\\ LH0 , T) < C(||a || ff(VOiL) + U^b^i) + IMUw))- 
Finally 



(2.308) 



2/ GC°([0,T];ff ( 1 o) (0,L))nC 1 ([0,T];L 2 (0,L)). 



Inequality (2.3071 is a hidden regularity property; see Remark 2.10 



on page 



32 



Proof of Theorem 2.53 We only prove the existence statement together with 



(2.306 I and (2.307). For the uniqueness statement, one can proceed, for example, as 



in the proof of the uniqueness statement of Theorem |2.4| on page |27| One can also 
use the method explained in [3291 (the proof of) Theoreme 8.1, Chapitre 3, page 
287] or [29T1 Theorem 3.1, Chapter IV, page 157]. For fl2.308| , see, for example, 
[321)1 (the proof of) Theoreme 8.2, Chapitre III, page 296]. 
Let 

' a ' 







;aGi/ ( 1 0) (0,L),/3GL 2 (0,L)J 



H := <Y 
This vector space is equipped with the scalar product 

(ai,a 2 ) ff i o) ( ,L) + (/?!, &) i 2 (o,i)- 



H 



As usual we denote by || ■ ||# the norm in H associated to this scalar product. Let 
A : T>(A) C H — > H be the linear operator defined by 

V(A) := | ry G H;a G 7J 2 (0,L), G fl? 0) (<),£), a x (L) = oj , 

,1 



^)gP(A). 
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(i'i 



Note that 
(2.309) 
(2.310) 
Moreover, 



T>(A) is dense in H, 
A is closed. 



(2.311 



) (AY, Y) H = J (f3 x a x + a xx /3)dx = 0, VF := r*\ 



eV{A). 



Let A* be the adjoint of A. One easily checks that 
(2.312) A* = -A. 



From the Lumer-Phillips theorem (Theorem A. 4 



on page 



374), (2.309), (2.310), and 



(2.312 |, A is the infinitesimal generator of a strongly continuous group of isometries 
S(t), t e K, on H. 

Let T > 0. Let us first treat the case where a G C 1 ([0,T] x [0,L]) and u G 

u(0) = u(0) = 0, 

eV{A). 



C 3 ([0,T]) is such that 

(2.313) 

and 



F u 



/i' 



Then the map 

/: [0,31 X IT 



H 




-a(i, x)a(a;) — u(i)x — ait, x)u(t)x 



is continuous in t G [0, T], uniformly globally Lipschitz in (a, /3) tr G ff, and contin- 
uously differentiable from [0, T] x H into H. By a classical result on perturbations 
of linear evolution equations (see, for example, [3811 Theorem 1.5, Chapter 6, page 
187]) there exists Z := (a,/3) tr G C 1 ([0,'I i \', H) D C°([0,T];V(A)) such that 



dZ 
"dT 



AZ 







di "' \ y —a(t,x)a — u(t)x — a(t,x)u(t)x / 
(2.315) Z(0,-) = Y°. 

Let Y G ^([O, T]; 77) n C°([0, T]; ,ff 2 (0, L) x H 1 ^, L)) be defined by 



(2.316) 



Y{t,x) := Z(t,x) + 



u(t)x 




V(t,x) G [0,T] x [0,L). 



Let G ^([OjTl x [0,L]) satisfy ( |2.30l[ ) and let r G [0,T]. Let y be the first 
compo ne nt of Y . Th en y is in ^([O, T]; JJ^(0, L))nC°([0, T]; g 2 (0, L)) and satisfies 
(2.2981, (2.299) and (2.3001 in the usual sense. In particular, it is a solution of the 
Cauchy problem ( |2.298| -( |2.299| -( |2.300[ ) in the sense of Definition [2J52J We multipl y 
(2.2981 by <f> and integrate the obtained equality on [0,r] x [0,L]. Using (2.2991, 
( 2.300 1, ( |2.301| and integrations by parts, one gets ( |2.302| . We multiply ( |2.298[ ) 
by y t and integrate on [0,L]. Then, using an integration by parts together with 
( |2.299| , we get 

(2.317) E(t) = - f ayy t dx + u(T)y t (T,L),VTe{0,T] 7 
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with 
(2.318) 



E(r) := 



{yf{T,x) + y 2 x (T,x))dx. 



Let r 6 [0,T]. Let us now take </> := xy x in (2.3021 (which, by (2.3081, holds 
for every r £ [O,? 1 ]) and integrate on [0,t] x [0,L]. One gets, using (2.299) and 
integrations by parts, 



(2.319) / E(t)dt+ 

Jo Jo 



L ,-L 

xyt(T,x)y x (T,x)dx — / xa x f3 a dx 
Jo 

L 



o Jo 



axy x ydxdt 



L 



{u 2 {t) + yi{t,L))dt. 



We have 
(2.320) 



2\u(t)y t {t,L)\ ^ ey t {t,L) 2 + -u(tf, Ve e (0,+oo). 



From ( |2.305| , fl2.317| , fl2.318| , fl2.319| , (|2_320|, Gronwall's lemma and Sobolev 
inequalities, 

(2.321) 



E(t) < CE(0) + C [ \u(t)\\y t (t,L)\dt 
Jo 

< \e(t) + CE(0) + C [ E{t)dt + C I 
2 Jo Jo 



u 2 (t)dt. 



In (2.321 1 and until the end of this section, C denotes various constants which may 
vary from line to line and depend only on T > 0, L > and R Jj 0. In particular, 
these constants C in (2.3211 do not depend on a £ L°°((0,T) x (0,L)) satisfying 
( |2.305| . From ( |2.321[ ), we have 

(2.322) E{t) < CE(0) + C [ E{t)dt + C [ u 2 {t)dt. 

Jo Jo 

From Gronwall's lemma, (2.3181, and (2.3221, one gets 

rL 



(2.323) 



(y 2 x (T,x)+yl(r,x))dx^C / (\a° x (x)\ 2 + \P°(x)\ 2 )dx 







n 



+ C / u 2 (t)dt,VTE [0,T]. 
Jo 



Let us point out that from (2.319) and (2.3231 one gets 

(2.324) \\y t (;L)\\ LH0 , T) < C(||a°|| H i o)(0ii) + \\P°h H0 , L) + \\u\\ LH o,t))- 



Now let a £ L°°((0,T) x (0,L)) satisfy ( |2.305| , let u £ L 2 (0,T) and let (a ,/? ) g 
H{ Q) (0,L) x L 2 (0,L). Let a„ £ C 1 ^^} x [0,L]), u" £ C 3 ([0,T]) satisfy (|2.313|>, 
(a° , /3°) tr e 23(A) be such that, as n -» oo, 

(2.325) a„ -» a in L 2 ((0, T) x (0, £)), 

(2-326) ll a n||L=°((0,T)x(0,i)) ^ 2?, 

(2.327) u„ -* u in L 2 (0,T), 

(2.328) a° -» a in 22 1 (0,L) and /3° -» /3° in L 2 (0,T). 
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Let y n G C 1 ([0,T];H 1 (0,L))nC°([0,T];H 2 (0,L)) be such that, in the usual sense 
(see above for the existence of y n ), 

(2.329) y ntt - y nxx + a(t, x)y n = 0, t G (0, T), x G (0, L), 

(2.330) y n {t, 0) = 0, j/ nx (t, L) = u n (t), t G (0, T), 

(2.331) JfeM = a° n {x), y nt (0,x) = j3° n {x), x G (0,L). 

Let r G [0,T] a nd let G CH|0,T] x [Q,L]) be such that ( |2.30l| holds. From 
( |2.329| , ( |2.330| , ( |2.331| and ( |2.301[ ), we get (see the proof of ( 2.302 )) 

(2.332) / y nt ( T ,x) ( j ) (T,x)dx- / Q n {x)<j>{Q,x)dx 



u n (t)4>(t,L)dt = 0. 



o jo 



(4>tVnt - 4>xVnx - a n (py n )dxdt 



By 03.323) , 

(2.333) / (yl x (r,x)+y 2 nt (r,x))dx^C f (\a° nx (x)\ 2 + K(x)\ 2 )da 

JQ JO 



+ C / u 2 n {t)dt, VrG [0,T]. 



By fl£324) , 

(2.334) ||y„ t (-,L)|| L2(0iT) < Cr(||a°|| ff i o)(0li) + ||0°||l»(o,l) + IKIU=(o,t))- 



By ( |2.327| , ( |2.328| , ( |2.333[ ), and ( |2.334| , 

(2.335) (Vn)neN is bounded in L°°((0,T); ffJ^O, L)), 

(2.336) (Vnt)»ew is bounded in L°°((0, T); L 2 (0, L)), 

(2.337) (y n4 (-,L))„ eN is bounded in L 2 (0,T). 

Hence, extracting subsequences if necessary, we may assume that there exists 
y G £°°((0 T);g ^(0 L)), w ith j/ t G L°°((0,T); L 2 (0, L)) and y t (-,L) G L 2 (0,T), 
satisfying (2.3061 and (2.3071 such that 

(2.338) 



!Jn 



y x weakly in L ((0, T) x (0, L)) as n — > oo, 



(2.339) 
Letting n 



2/nt -* 2/t weakly in L 2 ((0,T) x (0,£)) as n 



oo. 



oo in (2.332) and using (2.325), (2.327), (2.328), (2.3381 and (2.3391, 



we get (2.3021. This concludes the proof of the existence part of Theorem 2.53 
together with the inequalities (2.3061 and (2.3071. ■ 

2.4.2. Controllability. Let us now turn to the controllability of the control 
system ( 2.296 )-( 2.297 1. We start with a natural definition of controllability. 



Definition 2.54. Let T > 0. The control system ( |2.296[ )-( |2.297[ ) is control- 
lable in time T if, for every (a ,/? ) G HLAQ,L) x L 2 (0,L) and every (a 1 ,/? 1 ) G 
H} Q s(0,L) x L 2 (0,L), there exists u G L 2 (0,T) such that the solution y of the 
Cauchy problem ( |2.298| -( |2~299| -( |2.300[ ) satisfies (y(T,-),y t (T,-)) = (a 1 ,/? 1 ). 

With this definition we have the following theorem, which is due to Enrique 
Zuazua [5151 I5T6] . 
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Theorem 2.55. Let T > 2L. Then the control system \2.290Q - \2.29iy is con- 
trollable in time T. More precisely, there exists C := C(T, L, R) such that, for 
every a e L°°((0,T) x (0, L)) satisfying 

(2-340) ||a||L=((o,T)x(o,L)) < R, 

for every a € H} Q J0,L), for every (3° € L 2 (0,L), for every a 1 S H} Q J0,L) and 
for every (3 1 € L 2 (0,L), there exists u € L 2 (0,T) satisfying 

(2.341) |M| LW) < C(||a°|| H(lo)(0iL) + ||/3 || l2( o,l) + W^Wh^o.l) + \W 1 \\ia(.o,l ) ) 

and such that the solution y of the Cauchy problem (2.298)- (2.299)- (2.300) satisfies 
(y(T,-),y t (T-)) = (a\pi). 



In order to prove Theorem 2.55| we use the duality between controllability and 



observability (as in Section 2.1.2.3 for the transport equation and as in Section 2.2.2 



for the Korteweg-de Vries equation). 

Let T > 0. Let us define a linear map Tt '■ L 2 (0, T) — > H in the following way. 
Let ue L 2 {0,T). Let ye C l ([0, T]; L 2 (0, L)) H C°([0, T]; H 1 ^, L)) be the solution 
of the Cauchy problem 



(2.342) 
(2.343) 
(2.344) 

Then 



Vtt -Vxx + ay = 0,te (0, T), x e (0, L), 

y{t,0)=0,y x {t,L) = u{t),te(0,T), 

y(0,x)=0,yt(0,x)=0,xe(p,L). 



Ft{u) :-- 



y(T,-) 
yt(T,-) 



One has the following lemma, which is proved in the same way as Lemma 2.15 
page [34) 



Lemma 2.56. The control system (2.94)-(2.95) is controllable in time T if and 
only if Tt is onto. 

Again, in order to prove that Tt is onto, one uses Proposition |2 . 1 6] on page [35] 
In order to compute the adjoint of Tt, let us introduce some notations. Let A" 1 
be defined by 

A" 1 : L 2 (0,L) -» H 2 0) := {z e H 2 (0,L); z(0) = z x (L) = 0} 
/ *-> z, 



where z is the solution of 

z X x = f, z(0) = z x (L) = 
Let us consider the Cauchy problem 
(2.345) d (P\_(Q-A-HaQ) 

(2.346) 
(2.347) 



dt \QJ ~ V p xx 

P x (t,L) = 0, Q(t,0) = 0, t G (0,T), 

P(T,x) = P T (x),Q(T,x) = Q T (x), x e (0,L), 



where (P T ,Q T ) tr is given in H. Let us recall that S denotes the group associated 
to A (see page 69). Then we adopt the following definition. 
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Definition 2.57. A solution of the Cauchy problem \2.345\ - \2.34by - \2.34T^ is 
a function Z : [0, T] -> H, 1 1-> (P(t),Q{t)) tr such that 

Z€C°([0,T];ff), 
Z(r a ) = S(r 2 - Ti)Z(n) - f* 5(r 2 - t)(A- x (aQ), 0) tr dt, V(n,r 2 ) G [0,T] 2 , 

Z(T) = (P T ,Q T ) tr . 

Then arguing as in the proof of Theorem |2.53| on page [68] gives the following 
theorem. 



Th e orem 2.58. For every (P T ,Q T ) tr G H, the Cauchy problem (2.345)- 
(2.346)-(2.34 r /) has a unique solution. For such a solution, Q(-,L) G iJ _1 (0, T) 
is in fact in L? (0, T) . Moreover, there exists a constant C := C(T, L,R) such that, 
for every a G L°°((0,T) x (0,L)) such that 



(2.348) 



IMIl°<=((0,T)x(0,Z,)) < R, 



for every (P T ,Q T ) tr G H, the solution Z := (P,Q) tr of the Cauchy problem (2.345)- 
{2.34b^ - ^J4^ satisfies 

\\Z\\ c o {l0 ,T h H)^C(\\(P T ,Q T y r \\ H , 
\\Q(.,L)\\ LH0>T) ^C(\\(P T ,Q T r\\ H . 

Now we make T^ explicit by the following lemma. 

Lemma 2.59. Let 

Z T :=(P T ,Q T ) tr eH. 



Let Z : = (P,Q ) tr G C°([0,T];H) be the solution of the Cauchy problem \2.345\ - 
^J4~b^-^34^. Then 



(2.349) 



(T* T Z T )(t) = P t (t,L) + (A-\aQ(t, •)))(£), t G (0, T). 



Proof of Lemma |2.59 , Using the same approximation technique as in our 
proof of Theorem |2.53| on page |68| we may assume that 

«eC 1 ([0,T]x[0,L]), 

Z T G V(A), 

u G C 3 ([0,T]), w(0) = 0, u(0) = 0. 

Let y G C 2 ([0, T]; L 2 (0, L))nC 1 ([0, T]; H 1 ^, L)) nC°([0, T};H 2 (0, L)) be such that 

(2.350) y tt - y xx + ay = 0, 

(2.351) y(t,0) = 0, y x (t,L) = u(t), Vt G [0,T], 

(2.352) j/(0, •) = 0, y t (0, •) = 0. 



(See page 69 for the existence of such a y.) By the definitions of Tt and of y, 



(2.353) 



Jt(«) 



yt(r, ■) 
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Then, from (2.345), (2.346), (2.3471, (2.3501, (2.3511 and (2.3521, we get, with 



integrations by parts, 



{Z 1 ,Tt{u))h= / P x (T,x)y x (T,x) + Q(T,x)y t (T,x)dx 
Jo 

r-T ,-L 

{PxVx + Qy t )tdxdt 
'0 Jo 
r-T ,-L 

{PtxVx + PxVtx + PxxVt + QVxx - aQy)dxdt 
io Jo 

i-T 

P t (t,L)u{t)dt 

/<; 



I / (-PtVxx ~ PxxVt + PxxVt + QVxx - aQy)dxdt 
Jo Jo 

P t {t,L)u{t)dt+ / / {{A~ 1 (aQ))y xx - aQy)dxdt 



[P t {t,L) + {&- x {aQ{t,-))){L)]u{t)dt, 



which concludes the proof of Lemma |2.59| 



The observability inequality is given in the following proposition due to Enrique 
Zuazua |516l Section 3]. 

Proposition 2.60 (Observability inequality). Let us assume that T > 2L. 
Then ther e exists C := C(T,L,R) > such that, for every a G L°°((0,T) x (0,L)) 
such that \2.34ty holds, and for every (P T ,Q T ) tr £ H, 



(2.354) \\(P T ,Q T Y r \\ H < C\\^(P T ,Q T ) tr \\ LHOtT) . 

Theorem 2.55| on page [72] is a corollary of Proposition |2.16| on page [35] and 



Proposition |2 .60 



Let us prove only, instead of Proposition [2.60| the following weaker proposition 



(for a proof of Proposition 2.60 see [516, Section 3]) 



Proposition 2.61 (Weaker observability inequality). Let L > and T > 2L. 
Then there exist R := R(T,L) > and C* = C*(T,L) > such that, for every 
a e L°°((0,T) x (0,L)) such that 

( 2 -355) l|a||L=((o,T)x(o,L)) < R, 

and for every (P T , Q T ) tr € H , 

(2.356) \\(P T ,Q T ) tr \\ H < C*\\^(P T ,Q T ) tr \\ L i i0X) . 



Proof of Proposition |2.61| By easy density arguments, we may assume 
that a e C^QO.T] x [0,1,]) and that (P T ,Q T ) tr E V(A). Then, if Z := (P,Q) tv € 
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7F, 



C°{[0,T};H) is the solution of the Cauchy problem d2.345| - f^346[ )-( |2.347| ), 

(2.357) PeC ([0,T];i/ 2 (0,L))nC ,1 ([0,T];i7 1 (0,L)), 

(2.358) Q e C°([0, T]; ff x (0, L)) n C x ([0, T]; L 2 (0, L)), 

(2.359) Pt = Q~ A-\aQ) in C°([0, T]; ff^O, L)), 

(2.360) Q t - Pxx = in C°([0,T]; L 2 (0,L)), 

(2.361) P x (t, L) = Q(t, 0) = 0, Vt e [0, T]. 



We now use the multiplier method (see page 36 and Remark 2.19 above for some 
comments on this method). We multiply (2.359) by 2xP x t and integrate on (0,T) x 
(0,L). Using integrations by parts together with (2.3611 we get 

pi pi pL pL 

(2.362) = L P?(t,L)dt- / (P 2 + Pl)dxdt - 2 / [QxP x ]\zldx 

Jo Jo Jo Jo 



Let E : [0, T] 
(2.363) 



2 1 / {xA-\aQ)) x P t dxdt + 2L (A- 1 (oQ(i, -))){L)P t {t,L)dt. 
o Jo Jo 

be defined by 
E(t) := / (P 2 (t,a;) + Q 2 (^a;))da;, Vt € [0,T\. 



From fl2.359} , ( |2.360| , ( |2.361| and (|2_363j), one has 

(2.364) E = 2 aPQdx + 2P{t,0){A~ 1 {aQ){t,-)) x {0). 

Jo 

From now on we assume that 

(2-365) l|a||i~((o : T)x(o,L)) ^ 1- 

We denote by C various positive constants which may depend only on T and L. 
In part icular, these constants are independent of a £ L°°((0,T) x (0, L)) satisfying 
( 12.365} , of (P T ,Q T ) and of t E [0,7]. For / <= L 2 (0,L), one has the following 
expression of A -1 /: 

(2.366) (A~ l f)(x) = - 



f(s 1 )ds 1 ds 2 . 



Js 2 



From (2.3661, one gets the following standard estimate: 
(2.367) IIA-VlUw) < C|I/II^(o,l), V/ € L 2 (0, L). 



From (2.3641, (2.3671, and the Poincare inequality, one has 
(2.368) |PKC|MU~((o,T)x(o,L))P. 



From (2.3651, (2.3681, and the Gronwall lemma, one has 



(2.369) 



\E(t) - E(T)\ < C||a|| L ~ ((0 ,T)x(o,L))£(T), Vt € [0, T]. 



From (2.3591 and (2.3631, one gets 
(2.370) 

L 

(Pf(t,;r)+f*(t,a;))ck-.E(t)| < C , ||o|| L -, {{0> T)x(o,£))S(*). Vte [0,T]. 
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From (2.3631, we get 

(2.371) |2 f [QxP x ]\zldx\ < L(E(0) + E(T)). 

Jo 



From (2.3631 and (2.3671, one easily checks that 



(2.372) 
(2.373) 



{xA- 1 (aQ)) x (t,x)P t {t,x)dx\ < C7||o||i-((o,T)x(o,i))-B(t), Vt € [0,T], 

|(A- 1 (aQ(i,.)))(L)KC||a|| L » ((0 j )x(0iL)) i ! ;(t) 1 / 2 ,Vie[0,T]. 



From ( |2.362| , ( |2.363| , ( |2.365| , ( |2.369| , ( |2.370| , ( |2.371| , ( |2.372| and fl2.373| , one 

gets 



(T-2L-C||o|U-( (0 ,T)x(o,i)))^(T) 



^L 



[P t (t,L) + (A~\aQ(t,-)))(L)] 2 dt, 



which, using Lemma |2.59| on page |73| concludes the proof of Proposition |2. 61] ■ 

2.4.3. Comments. There is a huge literature on the controllability of linear 
wave equations for any space dimension. One of the best results on this subject has 
been obtained by Claude Bardos, Gilles Lebeau and Jeffrey Rauch in [34 . See also 
the paper [77J by Nicolas Burq and Patrick Gerard and the paper |76] by Nicolas 
Burq for improvements or a simpler proof. See also the paper [2lT by Robert 
Gulliver and Walter Liftman for hyperbolic equations on Riemannian manifolds. 
Let us mention also the survey paper [4261 Sections 3, 4 and 5] by David Russell 
and the books 186, Chapter 4] by Andrei Fursikov and Oleg Imanuvilov, [325 by 
Jacques-Louis Lions and |277j by Vilmos Komornik, where one can find plenty of 
results and useful references. 

2.5. Heat equation 

In this section O is a nonempty bounded open set of M. 1 , and lu is a nonempty 
open subset of £7. We consider the following linear control system: 

(2.374) y t - Ay = u(t, x), t G (0, T), x G 9,, 

(2.375) y = Q on (0,T) x dfl, 

where, at time t G [0,T], the state is y{t,-) G L 2 (£l) and the control is u{t, ■) G 
L 2 (fl). We require that 

(2.376) u(-,x) = 0, x en\uj. 

Hence we consider the case of internal control; see Section |2.5.3| and Section |2.7| 
below for cases with boundary controls. 

2.5.1. Well-posedness of the Cauchy problem. Again we start by giving 
a natural definition of a (weak) solution to the Cauchy problem associated to our 



control system ( 2.374 1-( 2.375 1, i.e., the Cauchy problem 

(2.377) y t - Ay = u(t, x), (t, x) G (0, T) x ft, 

(2.378) y = on (0, T) x SO, 

(2.379) y(0,x) = y°(x) : xen, 
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where T > 0, y G L 2 (S7) and u € L 2 ((0, T) x CI) are given. In order to motivate 
this definition, let us first assu me tha t there exists a function y of class C 2 on 
[0,T] xfi satisfying ( |2.377| to ( |2.379[ ) in the usual sense. Let r G [0,T] and let 
G C 2 ([0, r] x H) be such that 



(2.380) 



(t,x) = 0, V(*,x) G [0,r] x dCl. 



We multiply (2.377) by cf> and integrate the obtained equality on [0,r] x SI. Using 
(2.3781, (2.3791, (2.3801 and integrations by parts, one gets (at least if O is smooth 

(4>t + A(f))ydxdt — I / u<f)dxdt 



enough) 



o JO. 



o Jo. 



y(r,x)(j)(T,x)dx — / y (x)(p(0,x)dx = 0. 
n Jn 

This equality leads to the following definition. 

Definition 2.62. Let T > 0, let y° G L 2 (tt ) and le t u G L 2 ((0,T) x SI) be 
given. A solution of the Cauchy problem (2.377^ - f2.378^ - (2~37^ is a function j/ G 
C°([0,T];L 2 (fi)) such that, for every r S [0,T] and for every G C°([0, r]; ff 1 ^)) 
such that 

(2.381) ^.OeffoH^VielO.r], 

(2.382) t G L 2 ((0, T) x ST), A</> G L 2 ((0, T) x O), 
one has 



(2.383) 



o ./fi 



(0t + A(f>)ydxdt 



ucjjdxdt 

+ / y(r, x)(J)(t, x)dx 
Jq 



y°(x)(j)(0,x)dx = 0. 



In (2.381 1 and in the following, Hq(CI) denotes the closure in H 1 ^) of the set 
of functions tp G C°°(Cl) with compact support. Let us recall that, if CI is of class 
C 1 , then 

iji(fi) = {<p e H\n); tp = on <9S1} 

(see, e.g., [3j Theorem 5.37, page 165]). With Definition (2.621, one has the follow- 
ing theorem. 

Theorem 2.63. Let T > 0, y° G L 2 (CI) and u G L 2 ((0,T) x SI) be given. Then 
the Cauchy problem (2. 371)- (2. 37 8)- ( 2. 37 ty has a unique solution. This solution 
satisfies 

(2.384) \\y(T, .)|Ua ( n) ^ C(||y || L2( ^ + \\u\\ L * mT )xn)), Vr G [0, T], 

for some C > which does not depend on (y° 7 u) G L 2 (S1) x L 2 ((0,T) x CI). 

Proof of Theorem I2T631 Let 

H :=L 2 {Cl), 

equipped with the usual scalar product. Let A : T>(A) C H — > H be the linear 
operator defined by 

V(A) := {y e H^Cl); Ay e L 2 (Cl)} , 

Ay := Ay G H. 
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Note that, if is smooth enough (for example of class C 2 ), then 
(2.385) V(A) = H%(n) n H 2 {Q). 



However, without any regularity assumption on f2, (2.385) is wrong in general (see 



in particular [2041 Theorem 2.4.3, page 57] by Pierre Grisvard). One easily checks 
that 

(2.386) V(A) is dense in L 2 {n), 

(2.387) A is closed. 
Moreover, 

(2.388) (Ay, y) H = - f \\7y\ 2 dx, \/y £ D(A). 

Jn 

Let A* be the adjoint of A. One easily checks that 

(2.389) A* = A. 



From the Lumer-Phillips theorem (Theorem A. 4 



on page 



3741, (2.386), (2.3871 



(2.3881 and (2.3891, A is the infinitesimal generator of a strongly continuous semi- 
group of linear contractions S(t), t £ [0,+oo), on H. 

There are now two strategies to prove Theorem |2.63| 

(i) For the existence statement of Theorem 2.63 one can proceed as in the 
second proof of the existence statement of Theorem |2.4| on page 271 see 



also the proofs of the existence statement of Theorem |2.23| on page [39] 
or Theorem |2.53| on page |68| For the uniqueness statement of Theorem 
|2.63| one can proceed as for the uniqueness statement of Theorem |2.23| on 



page [39] 



(ii) One can use Theorem 2.37 



on page 



53 on the Cauchy problem for abstract 
linear control systems. For the Hilbert space U we take L 2 (u>). The linear 
map B £ C(U; D(A*)') is the map which is defined by 



(Bu)ip 



mpdx. 



Note that B £ L(U;H). Hence the regularity property (2.1991 is auto 



matically satisfied. Therefore Theorem |2.63| follows from Theorem |2.37| on 
page [53] provided that one proves that the two notions of solutions to the 



Cauchy problem (2.377 1-( 2.378 )-( 2.379 1 , the one given by Definition 2.36 



on page |53| and the one given in Definition |2.62| on the preceding page, 
lead to the same solutions. This fact can be checked by proceeding as for 



the transport equation (see page 63 I 



2.5.2. Controllability. Due to the smoothing effe ct of t he heat equation, 
itever y° £ L 2 (Q) and u £ L 2 ((0,T) x fi) satisfying (2.3761 are, the solution 
(0,T) x n -> R of the Cauchy problem ( |2.377[ )-( p3"78[ )- ^2.379| ) is such that y 
in (0,T] x (n\u). 



V 



is of class C°° in (0,T] x (Q\uJ). Hence, if O </i U, one cannot expect to have 
the controllability that we have found for the transport equation, the Korteweg-de 
Vries equation or the wave equation. More precisely, if Q <f_ w, there are y 1 £ L 2 (fl) 
such that, for every y° £ L 2 (f2), for every T > and for every u £ L 2 ((0,T) x 
fl) satisfying (2.3761, y(T,-) 7^ y . As proposed by Andrei Fursikov and Oleg 
Imanuvilov in 11851 [187] , for the heat equation, as for many equations where there 
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7') 



is a regularizing effect, the good notion of controllability is not to go from a given 
state to another given state in a fixed time but to go from a given state to a 
given trajectory. (A related notion of controllability in the framework of finite- 
dimensional control systems, has been also proposed by Jan Willems 503 1 for a 
different purpose.) This leads to the following definition. 



Definition 2.64. The control system ( |2.374| -( |2 375| -( |2.376[ ) is controllable if, 
for every T, for every y° G L 2 (J7), for every y € C u ([0, T ; L 2 (Vt)), and for every 
u £ L 2 ((0, T) x Q.) such that 

(2.390) u{t, x) = 0, (t, x) G (0, T) x Q, \ u, 
and such that y is the solution of the Cauchy problem 

(2.391) y t - Ay = u{t, x), (t, x) e (0, T) x O, 

(2.392) i/ = 0on(0,T)x3O, 

(2.393) y(0 7 x)=y(0,-)(x),xen, 

there exists u € L 2 ((0,T) x Q) satisfying (2.376) such that the solution y of the 



Cauchy problem ( |2.377| -( |2.378| -( |2.379[ ) satisfies 
(2.394) y(T,-)=y(T,-). 



Remark 2.65. Using the linearity of the control system ( 2.374 )-( 2.375 1-(2.376 1 



2.64 



2.39 



it is not hard to check that the notion of controllability introduced in Definition 
is equivalent to what is called null controllability in Section |2.3.2| see Definition 
on page [55] 

One has the following theorem, which is due to Hector Fattorini and David 
Russell [1621 Theorem 3.3] if I = 1, to Oleg Imanuvilov [242| 1243] (see also the 
book [186J by Andrei Fursikov and Oleg Imanuvilov) and to Gilles Lebeau and Luc 
Robbiano [30T] for I > 1. 

Theorem 2.66. Let us assume that Q is of class C 2 and connected. Then the 



control system (2.374)- (2.375)- (2.376) is controllable 



Proof of Theorem |2.66| From Theorem |2.44| on page |56| one has the follow- 
ing proposition, due to Szymon Dolecki and David Russell [146 . 

Proposition 2.67. Assume that, for every T > 0, there exists M > such 
that, for every y° € L 2 (Q), the solution y of the Cauchy problem 

(2.395) yt-Ay = 0,(t,x)e(0,T)xQ, 

(2.396) y = on (0,T) x dfl, 

(2.397) y(0,x) = y°(x),xen, 
satisfies 



(2.398) 



\\y(T,-)\\h m 



^ M 2 



y dxdt. 



Then the control system (2.374)-(2.375)-(2.376) is controllable 



Indeed, with the definiti ons of A , B, U and H given in Section [2. 5. 1| ine quality 



(2.2231 reads as inequality (2.398) with M 



.-1/2 



observability inequality for the control system ( 2.374 1-( 2.375 l-( 2.376 ) 



(Inequality ( 



2.3981 is the 



SO 
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Proof of the observability inequality ( |2.398[ ). We follow [TMl Chapter 1] 
by Andrei Fursikov and Oleg Imanuvilov; we establish a Carleman inequality 



which implies the observability inequality (2.398). Without loss of generality, we 
may assume that y° G Hq (ft). Let y be the solution of the Cauchy problem (2.395 )- 
(2.396 1-(2. 397). Let ujq be a nonempty open subset of u> such that the closure Uq 
of u>q in R' is a subset of u>. The first step is the following lemma, due to Oleg 
Imanuvilov [243, Lemma 1.2] (see also [186, Lemma 1.1 page 4]). 

Lemma 2.68. There exists ip G C 2 (ft) such that 

(2.399) ip > in ft, tp = on dft, 

(2.400) |V^(jc)| > 0, VxGft\w - 

Proof of Lemma |2.68[ Lemma |2.68| is obviously true if I = 1. From now on 
we assume that / Js 2. Let 5 € C 2 (fi) be such that: 

- The set of 2: G ft such that Vg(x) = is finite and does not meet c*ft. 

- g > on ft and g = on 9ft. 

The existence of such a g follows from classical arguments of Morse theory; see [186 
pages 20-21]. Let us denote by a,, i G {1, . . . , k} the x G ft such that V<?(x) = 0. 
Let 7; G C°°([0, 1]; ft) be such that 

(2.401) 7j is one to one for every i G {1, . . . , k}, 

(2.402) 7l ([0, 1]) n 7i ([0, 1]) = 0, V(t, j) G {1, . . . , k} 2 such that i ± j, 

(2.403) 7i(0) = ai,V»e{l,...,fc}, 

(2.404) 7t(l)ewo, ViG{l,...,fc}. 

The existence of such 7j's follows from the connectedness of ft. It relies on easy 
transversality arguments if I Js 3 (if / ^ 3, two embedded curves which intersect 
can be perturbed a little bit so that they do not intersect anymore). If / = 2, one 
proceeds by induction on k and by noticing that ft \ T, where T is a finite number 
of disjoint embedded paths in ft, is connected. Now let X G C°°(K™;K ra ) be such 
that 



(2.405) {x G R"; X{x) ^ 0} c ft, 

(2.406) X( 7< (t)) = 7ftt),V*e{l,...,*}. 

Let $ be the flow associated to the vector field X, i.e., $ 
$(£,x) satisfies 

X($), $(0,x) =i,VieK" 



(t,x) 



9$ 
9^ 



From (2.4061, one has 
(2.407) 



*(t,Oi) = 7i(t).Vte [0,1]. 



From ( |2.404| and ( |2.407[ ), one has $(l,o») G Wo- Note that, for ev ery r G R, $(r, •) 
is a diffeomorphism of R™ (its inverse map is $(— r, ■)). By (2.4051, for every r G R, 
$(r, ft) = ft and $(t, •) is equal to the identity map on a neighborhood of 9ft. 
Then one easily checks that tp : ft — > R defined by 

V>(x) :=<?($(-!,£)), Vz eft, 



satisfies all the required properties. This concludes the proof of Lemma |2.68| 



Let us fix tp as in Lemma 
(0, +00) be denned by 



2.68 
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Let a : (0, T) xtt -> (0, +00) and <f> : (0, T) xfi 



(2.408) 
(2.409) 



a(t,x) = — r , V(i,x) G (0,r) x ft, 



4>(t,x) 



t(T-t) 

e \ip(x) 



V(t,x) G (0,T) Xfi, 



t(T-t)- 
where A G [1, +00) will be chosen later on. Let z : [0, T] x £1 — > K be defined by 

(2.410) z(t, x) := e~ sa{t - x) y{t, x), {t, x) G (0, T) x O, 

(2.411) z(0, x) = z(T, a;) = 0, x G ft, 



where s G [l,+oo) will be chosen later on. From (2.395), (2.408), (2.409) and 
( |2.410| , we have 

(2.412) P x + P 2 = P 3 
with 

(2.413) Pi := -Az - s 2 X 2 <p 2 \\7ip\ 2 z + sa t z, 

(2.414) P 2 := zt + 2sX(jN^Vz + 2sX 2 <p\\7ip\ 2 z, 

(2.415) P 3 := -s\(j)(A^)z + sA 2 c/>|VV>| 2 z. 



Let Q := (0,T) x Q. From ( |2.412| , we have 
(2.416) 2 / / P 1 P 2 dxdt < 



P^dxdt. 



Q 
Let n denote the outward unit normal vector field on 9f2. Note that z vanishes 



on [0,T] x dn (see (2.3961 and (2.410)) and on {0,T} x ft (see (2.411)). Then 



straightforward computations using integrations by parts lead to 

(2.417) 2 P 1 P 2 dxdt = h + I 2 

with 



(2.418) I x 



(2s J AV|VV>| 4 |*r + As\ z 4>\Vil)\ z \Vz\^)dxdt 



Q 



T 

Jan 



, ,dib ( dz\ , , 
on V cm 



(2.419) J 2 



4sX(^i)jZiZj - 2s\(<jnpi)i\V z\ 



3 \ 3 i3 / 1 w^/.|2„/, \ _2 o „ \ 2/ j,| v7^/,|2\ _2 



+ 2^AV(|vv>r^)^ - 2 5 A 2 (^iwr)«^ 

sa«z 2 - 2s 2 X(Hj l a t ) l z 2 + As 2 X 2 cj)a t \S7 i)\ 2 z 2 + 2s 2 X 2 <j)(j)t\Vi)\ 2 z 2 )dxdt. 



In (2.4191 and until the end of the proof of Theorem 2.66 on page |79| we use the 



usual repeated-index sum convention. By (2.4001 and (2.4091, there exists A such 



S2 
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that, for every A ^ A, we have, on (0, T) x (Q, \ u>o), 

(2.420) 

-4A 2 </>|VV>| 2 |a| 2 < 4A(^ i ) J -o i o j - 2A(</)V 4 ) 4 |a| 2 , Va = (oi, . . . , a„) tr € R n , 
(2.421) -A 4 ^> 3 |VV| 4 < 2A 3 </. 3 (|V^| 2 V,),. 



We take A := A. Note that, by (|2.399|) 

(2.422) 



dip 



On 



< on dtt. 



Moreover, using (2.4081 and (2.409), one gets, the existence of C > 0, such that, 
for every (t, x) E (0, T) x O, 

(2.423) \a tt \ + \(H> iat )i\ + |^t|VV| 2 | + |^*|V^| 2 | 

+ |^(|v^| 2 V^I + l^ 3 |vvi 4 K ' 



(2.424) \</>(A^)\ + |</>|VV| 2 | + {(MM + \(<hPi)i\ + M^\ 2 h\ < 



t 3 (T-t) 3 ' 

C 
t(T - t) ' 



(2.425) 



\(4"Pi)j\ < 



C 



t(T-f) 



V(i,i)6{l,...,J} s 



From (2.4001 and (2.4091, one gets the existence of C > such that 

< C</> 3 |VV| 4 (M), V(i,ar) e (0,T) x (ft\u> ). 



(2.426) 



1 



t 3 (T-ty 



Using (2.416) to (2.4261, we get the existence of C > such that, for every s ^ 1 

M 2 



and for every j/°, 
(2.427) s 3 



(0/ 



T)^V„i 3 (r-t)' 



rdxdt < Cs 2 



a 



Q t 3 (T-ty 



Cs 6 



:dxdt 



|Vz| 2 +M 



dxdt. 



'(0,T)L„ *3(T-t)3 

Hence, for s Jj 1 large enough, there exists Co > independent of j/° such that 

|Vz| 2 +|z| 2 
i ; ./,. ./„ ^ ^ 3 (T-t)3 



(2.428) 



2T/3 /> /-T 

z| dxrft $J Cq 



-dxdt. 



We choose such an s and such a Co- Coming back to y using (2.408) and (2.4101, 
we deduce from (2.428) the existence of ci > independent of y" such that 

/•2T/3 /■ r T r 

(2.429) / \y\ 2 dxdt^ Cl / i(T - i)(|Vy| 2 + |2/| 2 )dircft. 

Jt/3 Jn Jo Ju> 

Let p e C°°(n) be such that 

p = 1 in w , 
p = in f2 \ w. 
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K>, 



We multiply (2.395 ) by t(T—t)py and integrate on Q. Using (2.396 1 and integrations 
by parts, we get the existence of c 2 > independent of y° such that 

(2.430) f f t{T-t){\\7y\ 2 + \y\ 2 )dxdt^c 2 f f \y\ 2 dxdt. 



From (2.4291 and (2.4301, we get 



(2.431) 



2T/3 /• l' T f 

\y\ dxdt ^ c\c 2 I I \y\ dxdt. 

T/3 Jn JO Jlo 



Let us now multiply (|2.395|) by y and integrate on Q. Using integrations by parts 

d 



together with (2.3961, we get 
(2.432) 



d/ 



\y(t,x)rdx^0. 



From ( |2.431| and ( |2.432| , one gets that (|2.398| holds with 

M :-- 



3cic 2 



This concludes the proof of Theorem |2.66| on page W9\ 



Remark 2.69. Let us emphasize that c\ and c 2 depend on u> 7 fl 7 and T. Sharp 
estimates depending on w, Cl, and T on the minimum of the set of constants M > 



satisfying (2.3981 have been obtained by Enrique Fernandez-Cara and Enrique 



Zuazua in [168 and by Luc Miller in [357 . 



The interest in the minimum of the set of constants M > satisfying (2.398) 
is justified in the following exercise. 

Exercise 2.70. Let T > be given. Let K± be the minimum of the constants 



M > such that inequality (2.398) holds for the solution y of the Cauchy problem 



\2.39^ - $M(§ - \2.39 r § for every y° € L 2 {fl). For y° e L 2 (fL), let U(y°) be the set 
of u e L 2 ((0, T) x CI) such that u vanishes on (0, T) x (O \ lu) and such that this 
control u steers the control system (2.374)-(2.375) from y° to in time T, which 
means that the solution y of the Cauchy problem (2.377)-(2.378)-(2.379) satisfies 
y(T,-)=0. Let 

{miii{|M| L2(0iT) ;weC/(2/ )}}. 



K, 



sup 

lll/ llz,2(n) 5 



Prove that K\ = K 2 . (Hint. Just apply Theorem 2.44 



on page 



56) 



2.5.3. Motion planning for the one-dimensional heat equation. This 
section is borrowed from the paper [295] by Beatrice Laroche, Philippe Martin and 
Pierre Rouchon. Let us consider the following control heat equation: 

(2.433) y t -y xx = 0,te (0, T), x £ (0, 1), 

(2.434) y x (t 7 l)=u(t),te{0,T), 

(2.435) I/x(*,0)=0,te(0,T). 

It models a one-dimensional rod (0, 1). Heat is added from a steam chest at the 
boundary x = 1, while the boundary x = is assumed to be perfectly insulated. For 



SI 
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the control system ( |2.433[ )-( p^434| )-( |2.435| ), the state at time t is y(t, ■) : [0, 1] -> R 
and the control is u(t) G M. 

Proceeding as for Definition |2.1| on page |25| Definition |2.21| on page [38] or 
one is led to adopt the following definition. 



Definition 2.52 



on page 



Definition 2.71. L et y° G L 2 (0, 1 ), T > and u G H 1 ^, T). A solution of the 
Cauchy problem ( |2.433| , ( |2.434| and ( |2.435| is a function y G C°([0, T]; L 2 (0, L)) 
such that, for every r G [0, T] and for every 

<p G ^([0, r]; L 2 (0, 1)) n C°([0, r]; ff 2 (0, 1)) 

such that 

<p x (t,o) = <p x (t,i)=o,Vte [o,t], 

one has 



y(T,x)ip(T 7 x)dx - 



y°(x)ip(0,x)dx - 
o Jo 



y(<Pt + <fixx)dxdt 

u(t)ip(t,l)dt= 0. 



One has the following theorem. 

The orem 2. 72. Le t T > 0, y° e L 2 (0, 1) and u e H l {Q,T). Then the Cauchy 
problem, (2.433), (2.434 ) and (2.435) has a unique solution y. This solution satisfies 

(2.436) IMIc«([o,t];L2(o,l)) < C(T)(||j/ || L 2 (0i1) + ||u|| h i ( o,d), 

where C{T) > is independent on y° and u. 



Proof of Theorem 2.72, It is very similar to the proofs of Theorem 2.4 



page |27| Theorem |2.23| on page [39] or Theorem |2.53| on page |68| We briefly sketch 
it. Let H := L 2 (0, 1) and let A : T)(A) — » H be the linear operator defined by 

V(A) := {/ G H 2 (0, 1); / x (0) = f x (l) = 0}, 

Af = /„, V/ G H. 

One easily checks that 

T>(A) is dense in H, 

A is closed and dissipative, 

A = A*. 

Hence, by Theorem |A . 1 0| on page |375] the operator A is the infinitesimal generator 
of a strongly continuous semigroup S(t), t G [0, +oo) of continuous linear operators 
on H. Then one easily checks that y G C°([0,T]; L 2 (0, 1)) is a solution of the 
Cauchy problem ( |2.433| , ( |2.434[ ) and ( |2.435[ ) if and only if 

(2.437) 



y(t,-) 

with 
(2.438) 



u(t)6 + S(t)(y Q -u(0)8) 



9{x) :-- 



S{t - s)(u(s)e - u{s)6 xx )ds, Vi G [0, T], 



Vie [o,i]. 



Inequality (2.436) follows from (2.4371 and (2.4381. This concludes the proof of 
Theorem [27721 ■ 
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It has been proved by Hector Fattorini and David Russell in 162, Theorem 
3.3] that, for every T > the linear control system ( 2.433 l-(2.434 )-( 2.435 I is null 
controllable in time T: for every y° G L 2 (0, 1), every i/ u G £ 2 (0, 1) and every T > 
there exists u G L 2 (0,T) such that the solution y to the Cauchy problem (2.433 
( |2.434| and J2.435|) satisfi es y(T,-)^S{T)y°. (See Definition 

on page 



Hence, by Theorem 2.45 



2.39 



57 the linear control system (2.433 I- (2. 434) 



on page 



55 



(2.435 I is approximately controllable in time T, for every T > 0. That is, for every 



£ > 0, for every T > 0, for every j/° G L 2 (0, 1) and for every y 1 G £ 2 (0, 1), there 
exists u G L 2 (0,T) such that the solution of the Cauchy problem 

(2.439) y t -y xx = 0,te (0, T), x G (0, 1), 

(2.440) l/x(*,l) =«(*). *e(0,T), 

(2.441) y x (t J 0) = 0,tG(0,T) > 

(2.442) y(0,x) = 2/ (x),xG(0,l), 

satisfies 

||»(T,-)-» 1 |U»(o > i)<e- 

In fact the approximate controllability is eas- 



(See Definition 2.40 



on page 



55 



ier to get than the null controllability and has been proved earlier than the null 
controllability. It goes back to Hector Fattorini [159] , 

In this section we present a method to construct u explicitly. This method 
is based on the notion of differential flatness due to Michel Fliess, Jean Levine, 
Pierre Rouchon and Philippe Martin |175j . Roughly speaking a control system is 
differentially flat if every trajectory can be expressed in terms of a function z (called 
a flat output) and its derivatives. The control system ( 2.433 1-( 2.434 1-( 2.435 ) is flat 
and a flat output is 

z(t):=y(t,0). 
To see this, let us consider the following system 

(2.443) Vx*=Vt,t€(0,T),x€(p,l), 

(2.444) y«(i,0) = 0,te(0,T) > 

(2.445) y(t,0) = z(t), t e (0,T). 



This system is in the Cauchy-Kovalevsky form (see e.g. 
seeks formal solutions 



Theorem 1.1]). If one 



y(t,x) :-- 



^r 



X' 



4 = 



of (2.443 1-(2.444|-(2.445|, then one gets, for every i G N, 

a M (t) = * W (t), 

a 2 i+i(t) = 0. 



Therefore, formally again, 
(2.446) 

(2.447) 



y(t,x) 



OO 

£- 

i=0 



•W 



(*) 



„2i 



(2i)V 



u(t) = J2 



Ai) 



(0 



=i ( 2i - !) 



1)!' 
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If one wants to get, instead of formal solutions, a true solution, one needs to have 



the convergence of the series in ( 2.446 )-( 2.447 1 in a suitable sense. A sufficient 



condition for the convergence of these series can be given in terms of the Gevrey 
order of z. Let us recall the following definition, due to Maurice Gevrey [191, page 
132] (see also [Ml Definition 1.1]). 



DEFINITION 2.73. Let z : t G [0,T] (-> z{t) G K be of class C°°. Then z is 
Gevrey of order s G [1, +oo) if there exist M > and R > such that 

|z<"*>(t)| < M^, Vt G [0,T], Vm G N. 

Clearly a Gevrey function of order s is also of order s' for every s' > s. Note 
also that a Gevrey function of order 1 is analytic. In particular, every Gevrey 
function / of order 1 such that 

(2.448) f {t) {T) = for every i GN 

is identically equal to 0. This is no longer the case if one considers Gevrey functions 
of order strictly larger than 1. For example, let 7 G (0,+oo), T > and </? 7 : 
[0, T] -> R be defined by 

(0 if te {0,T}, 

P-rW : = \ „„„ /" -1 



exp 



«T-t)tp 



Then ify satisfies (2.4481 and is Gevrey of order 1 + (1/7) (see, for example, 
page 16]). This implies that <1> 7 



(2.449) 



* 7 (t) 



[0,T]^1 
/ *y 7 (r)d7 



ifte (0,T). 

er 1 + (1 
defined by 



,VtG[0,T], 



is also Gevrey of order 1 + (1/7). This function $ 7 will be used later on. 



Definition 2.73 of Gevrey functions of order s on [0,T] can be generalized to 



functions of two variables in the following way. 

Definition 2.74. Let y : (t,x) G [0,T] x [0,1] (-> y(t,x) G K be of class C°°. 
Then y is Gevrey of order s\ G [1, +00) m i and 0/ order s% G [1, +00) in cc if there 
exist M > 0, i?! > and i? 2 > such that 



Qrn+n 



dt m dx n 



(t,x) 



< M 



(m!) Sl (n!) S2 



V(i, a;) G [0, T] x [0, 1] , V(m, n) G N 2 



Now, concerning the convergence of the series in (2.446 1-( 2.447 1, one has the 
following theorem. 



Theorem 2.75 ([295, Theorem 1]). Assume that z G C°°([0, r]) is a Gevrey 
function of order s G [1,2). Then, for every t G [0,T], the series in (2.^6)- (2. 44^) 
are convergent. The function y defined by (2.446) is of class C°° and is a Gevrey 
function of order s in t and of order 1 in x. In particular, the control u defined by 
(2.447) * s of class C°° and is a Gevrey function of order s. Moreover, (y,u) is a 
trajectory (i.e., a solution) of the control system, (2.433)-(2.434)-(2.435). 



We omit the proof of this theorem. This theorem allows us to construct many 



trajectories of the control system (2.433 I- (2. 434)- (2. 435 I and in fact all the trajec- 
tories such that y is of class C°° and is a Gevrey function of order s in t and of 
order 1 in a; for any given s in [1,2). 
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NT 



Let us explain how to use this construction in order to move from a given state 
y° into a given neighborhood (for the £ 2 (0, l)-topology) of another given state y 1 . 
Let y° and y 1 be given in L 2 (0, 1). By the Miintz-Szasz theorem (see, for example, 
Theorem [420, Theorem 15.26, page 336]; one can alternatively use the Stone- 
Weierstrass theorem, see for example |421l 7.32 Theorem, page 162]) the set of 
polynomials of even degree is dense in C ([0, 1]) and therefore in L 2 (0, 1). Hence, 
if £ > is given, there exist two polynomials P° and P 1 , 



p°w = X>° 



i=0 



p\ X ) = Y j p\ 



~,pjGR,t€{0,.. 


.,n} 


|4,p!6R,i6{0,.. 


■,»} 



i=0 



such that 



||y -P°IU 2( o,i)<£, IIj/ 1 -^ 



(0T) 



€e. 



Let 7 G (l,oo) and let T > 0. Let z G C°°([0,T]) be defined by 



'W^E^TT^-^^+P 



i it - ry 



* 7 (t). 



i=0 



Then 2; is a Gevrey function of order 1 + (I/7) G (1, 2). Note that 

(2.450) z W (0) =p° andz w (T) = j£, Vie {0,...,ra}, 

(2.451) W (O)=O and z w (T) = 0, Vi G N \ {0, .. . ,n}. 



Following (2.4471, let 



u(t) := £ 



z«(i) 



^ (2i 
=1 v 



1 ! 



t€ [0,7*]. 



By Theorem 2.75 on the previous page, u(t) is well defined and the function u is of 
class C°° on [0,T]. Let u G C 1 ([0, T]) be any approximation of u in the following 
sense: 



\u- u|| C i([0,T]) < £■ 



For example, one can take 



iV 



m ■■= E 



,(0 



(0 



^(2» 



D! 



*g[o,t], 



for a large enough N. Then one has the following theorem, which is proved in 
[295] , 

Theorem 2.76. The control t G [0,T] 1— > u(t) G R steers the control system 



(2433 )-\ 24§^ - (^4§S ) from the state P° to the state P 1 during the time interval 
[0,T]. Moreover, there exists a constant K, which is independent of e G (0,+oo), 
T > 0, y° G L 2 (0, 1), y 1 G L 2 (0,1), i/te choices of P°, P 1 and u, such that the 
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solution of the Cauchy problem 

Vt-Vxw = 0,t€(0,T),x€(0,l), 

y x (t,0) = 0,te(0,T), 

y x (t,l)=u(t),t£ (0,T), 

2 /(o,x) = 2 /°(x),xe(o,i), 

satisfies 

||y(r,.)-y 1 ||i>.(o,i)<^e. 

We omit the proof of this theorem. 

Remark 2.77. One can find further generalizations of the flatness approach to 
more general one-dimensional heat equations in |295j . This approach has also been 
used for many other partial differential equations. Let us mention, for example, the 
works 

- |150j by Francois Dubois, Nicolas Petit and Pierre Rouchon and [385] by 
Nicolas Petit and Pierre Rouchon on water tanks problem (see also Section 
below) , 



6.3 



- [152] by William Dunbar, Nicolas Petit, Pierre Rouchon and Philippe Mar- 
tin on the Stefan problem, 

- |371] for the control of a vibrating string with an interior mass by Hugues 
Mounier, Joachim Rudolph, Michel Fliess and Pierre Rouchon, 

- [384 for the control of a heavy chain by Nicolas Petit and Pierre Rouchon, 

- [4161 1417] by Pierre Rouchon for the control of a quantum particle in a 
potential well (see also Chapter p\ below) . 

Remark 2.78. When the series (2.447[) diverges, one can try to use the "small- 



est term summation" . Such a summation technique is explained by Jean-Pierre 
Ramis in [397]. This summation has been applied in [295] . Numerically it leads 
to quite good steering controls, which turn out to be much softer. The theoretical 
justification remains to be done. 

2.5.4. Heat control system with a finite number of controls. Let m 

be a positive integer and let (/i, . . . f m ) € L 2 (Cl) m , where CI is again a nonempty 
bounded open subset of R . Let us consider the control system 

C y t (t, x) - Ay(t, x) = £™ x Ui(t)fi(x), {t, x) £ (0, T) x 0, 
(2.452) I y{t,x) = 0, (t,x) £ (0,T) x dCl, 

{ y(0,x) = y°(x),xeCl, 

where, at time t, the state is y(t, ■) and the control is u(t) = (u\(t), . . . ,u m (t)) tT £ 



The null controllability problem consists of finding, for every y £ L ( CI) 



m 



control functions u±, . . . ,u m in L 2 (0,T) steering the control system (2.4521 from 



y° to in time T, i.e., such that the solution y of the Cauchy problem (2.452) 



satisfies y(T, ■) = 0. (For definition, existence and uniqueness of a solution to the 



Cauchy problem (2.452 I, see Section 2.5.1 ) The main result of this section is that 



one never has null controllability if Z ^ 2. More precisely, the following theorem, 
due to Sergei Avdonin and Sergei Ivanov [22, Theorem IV. 1.3, page 178] holds. 

Theorem 2.79. Let us assume that 1^2. Let m be a positive integer and let 
fi,---,f m € L 2 (C1). Then there exists y° £ Hq(CI) with Ay £ L 2 (Cl) such that, 
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for every T > and for every ui, ■ ■ ■ ,u m € L 2 (0,T), the solution y of the Cauchy 
problem (2.452) satisfies 

y{T, •) / o. 

We propose in this section a proof which is a joint work with Yacine Chitour 
and slightly differs from the proof given in |22j . We first translate the question 
of existence of controls u\, ■ ■ ■ ,u m in L 2 (0,T) steering the control system (2.452) 
from y° to in time T into the existence of m entire functions (i.e., holomorphic 
functions on C) u±, . . . , u m solutions of an interpolation problem (2.459 I described 
below. 

Let y° € Hq (O) be such that Ay € L 2 (fl). Assume that there exist m functions 
u\, . . . ,u m in L 2 (0,T) such that the solution y to (2.4521 satisfies y(T, ■) = 0. Let 
6 : K — > [0, 1] be a function of class C°° such that 



(2.453) 



6{t) = 0, if * > T, 
6{t) = l, if t < 0. 



Applying the change of the unknown 



(2.454) 
we get that 

(2.455) 



(2.456) 

(2.457) 



y(t J x) = 0(t)y°(x) + y(t,x), 



y t {t, x) - Ay{t, x)=J2 «i (*)/*(*) " 0(t)v°(aO 

i=l 

+ ^)Ay°(x),(i,x)e(0,T)xQ, 
y(t,x) = 0,(t,x) e (0,T) x 90, 

y(o,i)=j(r,x) = o ]3 ;en. 



For / € L^OjT), the Laplace transform / of / is defined by f(s) := L f(t)e~ st dt, 
s € C. In this section, we adopt a slightly different definition and set /(s) := 
Jo f(t) eSt dt for subsequent computational simplifications. 



Consider the following Laplace transforms (with respect to the time t). 

6(s) 

Jo 

r 7 

Ui(t)e st dt, 1 < i ^ m. 



J 9{t)e st dt, ((s,x):= [ y{t,x)e st dt, 
Jo Jo 

fii(a):= / " '"■"'■ 
Jo 

Clearly 6 and Wj, i = 1, . . . ,m are holomorphic functions from C into C and s 
C(s, •) is a holomorphic function from C into Hq(Q). 

From (2.455), (2.4561 and (2.4571, we readily get that, for every s 6 C, 
(2.458) 

C( s ,-)e7Ji(fi), 

-s(( s , •) - ac( s , •) = (££ i ^( s )/*) + y° + ^( s ) ( A ?/ + s y°) in tf -1 ^)- 

As on page |77[ let us denote by A the Laplace-Dirichlet operator: 

V {A) := {v e ^o(fi); Aw e L 2 (^)}, 

Aw = Aw, Vw e V (A) . 
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It is well known that 

A* = A, 

A is onto and A~ is compact from L (Vt) into L (CI). 

Then the eigenvalues of A are real and the Hilbert space L 2 (fl) has a complete 
orthonormal system of eigenfunctions for the operator A (see, for example, |71| 
Theoreme VI. 11, page 97] or fiAl\ Theoreme 3, page 31-32] or [267] page 277]). 
If s is an eigenvalue of —A, then, by the Fredholm alternative theorem, equation 



(2.4581, where £(s, •) G Hq(Q.) is the unknown, has a solution (if and) only if 



(2.459) >^WiO) / fiwdx+ / y u wdx = 0, 



Wi-.fVt / fsinAr. + / ii° 



i=l Jn 

for every eigenfunction w G L)(A) associated to the eigenvalue s. 

We are now able to express the initial null controllability of system (2.4521 in 
terms of a complex analysis problem. We need the following notation. 

Let Aq,b be the class of entire functions g such that there exists K g > for 
which 

(2.460) \g(s)\ < K g e Bmax{0 ' Re( - s)} , Vs G C. 

By the (easy part of the) Paley- Wiener theorem, the Laplace transform of any 
function in L 2 (0, T) belongs to Aq,t- Also, let A be the set of holomorphic functions 
/ : C — > C such that, for some positive constants K and a depending on /, 

(2.461) \f(s)\ < Ke alKQsl , Vs G C. 

Clearly Aq.t C A. 

Let us recall a classical result providing a sufficient condition for the nonexis- 
tence of a nonzero holomorphic function / in A depending on the distribution of 
the zeros of /. 

Lemma 2.80. Let f : C — > C be in A. Let us assume that there exists a sequence 
( r k)k^i °f distinct positive real numbers such that 



(2.462) 



oo 1 

E 1 

fc=i K 



(2.463) f(r k ) = 0. 

Then f is identically equal to 0. 



Lemma 2.80 is a consequence of a much more general theorem due to Mary 
Cartwright and Norman Levinson; see J315L Theorem 1, page 127]. It will be used 
repeatedly in the sequel, together with the following definition. 

Definition 2.81. A subset S of positive real numbers is said to be admissible 



if it contains a sequence of distinct positive real numbers (r k )k^i such that (2.462 ) 
holds. 

We argue by contradiction: until the end of the proof of Theorem |2.79| we 
assume that 

( . M(U| , Vy° G V(A),3T > 0,3(u u ...,u m ) G L 2 (0,T) m such that 



the solution y of (2.4521 satisfies y(T, ■) = 
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The proof of Theorem |2.79| is now decomposed in two steps: the case m = 1 
and the case m Js 2. 

2.5.4.1. The case m = 1. By (2.464), for every y° £ P(^4) , there exists u G 
L 2 (0,T) such that the solution y of the Cauchy problem (2.4521 satisfies 

(2.465) y(T,-) = 0. 



Using (2.4591 and (2.465), we get that, for every eigenvalue s of the Laplace- 
Dirichlet operator —A and for every eigenfunction w : — > R associated to s, 

(2.466) 

We first claim that, for every nonzero eigenfunction w of —A, 



^( s ) / fiwdx + / y°wdx = 0. 



(2.467) 



fiwdx jtz 0. 



Indeed, if there exists a nonzero eigenfunction w of —A such that 

fiwdx = 0, 



then, from (2.4661, it follows that 
(2.468) 



y°wdx = 0, 



but there exists y € 2?(.A) which does not satisfy (2.4681 (e.g., j/° := w). Hence 
one has (2.4671. Let < Ai < A2 < ■ • • < Xj < Aj+i < ... be the ordered 
sequence of the eigenvalues of the Laplace-Dirichlet operator —A. Let y° be a 
nonzero eigenfunction for the eigenvalue Ai. Clearly, y° G D(A). Moreover, if s is 
an eigenvalue of —A different from Ai, then 

y wdx = 



for every eigenfunction w associated to the eigenvalue s. Therefore (2.4661 and 
(2.4671 imply that u(A,) = for every j £ N\ {0,1}- Let us assume, for the 
moment, that the following lemma holds. (This lemma is a classical Weyl estimate; 
for a much more precise estimate when f2 is smooth; see the paper [248J by Victor 
Ivrii.) 



Lemma 2.82. Assume that (2.464) holds. Then there exists A > (depending 
on CI) such that 



(2.469) 



A 3 aj 2/i ,VjGN\{0}. 



By applying Lemma |2.80| and Lem ma |2.82| we conclude that u = and hence 
u = 0. Therefore, for such a y°, system (2.452) reduces to 



(2.470) 



y t (t, x) - Ay(t, x) = 0, if (t, x) e (0, T) x n, 
y(t,x)=0, if (t,x) e (0,T) xdCl, 

y(0,x) = y°(x), iixeCl. 



The solution to (2.4701 is given by 

v(*,a:):=e- Al V(*)» 

and so y(T, •) 7^ 0. This is a contradiction with the fact that y(T, •) = 0. 
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It remains to prove Lemma |2.82| on the previous page. This lemma holds for 
every to G N and since we will need it to treat the case m Jj 2, we give a proof of 
Lemma |2.82| which works for every m G N. 

We start with a very classical lemma on the multiplicity of the eigenvalues. 

Lemma 2.83. Assume that (2-464) holds. Then, for every eigenvalue A of —A, 



the multiplicity of A is at most to. 

Indeed, if the multiplicity of the eigenvalue A of —A is strictly larger than to, 
there exists w G "D(A) such that 



—Aw = Aw, 
wfidx = 0, Vi G {1, 



(2.471) 

(2.472) 

(2.473) w J- 

Let y° be in V{A). Let T > and let m, . . 



,to}, 



be in L 2 (0,T). Let us denote by 



y the solution of the Cauchy problem ( |2.452[ ). From fl2.452| , ( |2.471| and ( |2.472 l 
one first gets 



d 

di 



y{t,x)w(x)dx 



-A / y(t,x)w(x)dx 



y{T 1 x)w{x)dx = e 



-XT 



y wdx. 



and then 

(2.474) 

Let us take y° = 

contradiction with our controllability assumption (2.464). This concludes the proof 

of Lemma 12.831 ■ 



From (2.473) and (2.4741, one gets that y(T, •) ^ 0, in 



Let us now go back to the proof of Lemma |2.82| on the preceding page. For a 
bounded nonempty open subset U of R l , let Au : T>(Au) C L 2 (U) —> L 2 (U) be the 
linear operator defined by 

V{A V ) := {y G H*(U); Ay G L 2 (U)} , 
A v y := Ay G L 2 (U). 

Let us denote by < Hi{U) ^ ^(U) ^ . . . < Hj(U) ^ /j,j+x(U) < . . . the ordered 
sequence of the eigenvalues of the operator — Au repeated according to their multi- 
plicity. Let U and U' be bounded nonempty open subsets of R' such that U C U' . 
Extending by on U' \ U every function in Hq(U) we have Hq(U) C Hq(U'). 
Then, using the classical min-max characterization of the fij's (see, for instance, 
[4011 Theorem XIII. 1, pages 76-77]) one gets 



(2.475) 



Mi (C/')^^(J7),VjGN\{0}. 



For e > 0, let Q E 

c+Q £ :={x + y;yeQ £ }cn. By d2J75| 



(2.476) 



(0, e) . Let e > a nd c := (ci,...,q) G I" be such that 
Q C ft. By ( pl75| , 

Mi (fi)^Mi(c + Q £ ),ViGN\{0}. 
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But, for every (ji, . . . ,ji) € (N \ {0})', the function 



<KS 



x := (xi 



,xi) e c + Q £ 



fe=i 



( njkjxk - gfc) 



is an eigenfunction of A c+ q c and the corresponding eigenvalue is 



* 2-2 

yQfc 

Z^ £ 2 • 
fc=l 

Hence there exists A' > (depending on e > 0) such that 
(2.477) nj(c + Qe) < A 1 ] 2 ' 1 , Vj e N \ {0}. 



By Lemma |2.83| on the preceding page, 

A^^(O),V j eN\{0}, 



which, together with (2.4761 and (2.4771, gives (2.469) if A := A'm 2/l . Thus Lemma 
|2.82| is proved. This concludes the proof of Theorem |2. 79 1 if m = 1. ■ 

2.5.4.2. The case m ^ 2. For j > 0, let Wj be an eigenfunction of the Laplace- 
Dirichlet operator — Aq corresponding to the eigenvalue Xj and satisfying 

w^dx = 1. 



For every a G T>{A), let (cij)j >0 be the sequence defined by cij := J^aWjdx. 
For such a function a, we use H(a) to denote the set given by 



H(a):={ieN\{0} 



, Uj 



0}. 



It is clear that, for every subset S of N \ {0} which is not equal to N \ {0}, there 
exists a nonzero element a € T)(A) such that H(a) = S. 

For every a € 2?(^4), let u\, . . . ,ii^ n be the Laplace transforms of controls 
uf, . . . , U^j in L 2 (0,T) steering the control system (2.452) from a to in time 
T. Let U(a) be the column vector of complex functions of coordinates w°, . . . , u^: 
U{a):={ul,...,u a m T. 

For j > 0, we define the column vector Fj of coordinates f„ fiWjdx, for 1 $C 
i ^ m. Then equation (2.4591 becomes 

(2.478) 



UianX^Fj 



for every j > and a G 2?(A). 

Adapting the argument of the proof of (2.467) to the case m ^ 2, it is clear 
that, for every j > 0, Fj is a nonzero vector. Let us define m nonzero functions 
a},...,a m in V(A) and H; := H(a'), 1 < / < m, such that 

(2.479) 

(2.480) VZe{l,. 

(2.481) VZe{l,. 



, m}, 3(5 > such that 

#{j; j O, j e ^} > <5fc, Vfc e N with fc > 1/5, 

, m}, 35 > such that 

#{j; j ^k, j e K;_! \ NJ > <5fc, Vfc e N with fc > 1/(5. 
It 



Here, H = N \ {0}. A possible choice is K, = (2 ; N) \ {0}, for 1 < I < 



!J4 
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Let us define the mxm matrix of com plex fun ctions V with rows Vi := U(a ) tT , 
for 1 $J I ^ m. For j £ K m , the equations (2.478) obtained for each a 1 , 1 ^ I ^ in, 
can be written at once by using V, namely 



(2.482) 



V{\j)F 3 = 0. 



0. From (2.4801 for I = m and 



Since Fj is nonzero, this implies that det V(Xj 

we get that {A^; j £ H m } is admissible (see Definition 



2.82 



on page 



91 



90 I. Moreover, det V, as the «", 



2.81 



is in A, where A is defined on page 



Lemma 

on page 

|90| Then the holomorphic function det V verifies the assumptions of Lemma |2.80 

on page 



90 



and therefore is identically zero. 
We obtain that, for every j £ H m _i \ H m , the rows U(a l ) tI (Xj), for 1 < I ^ m, 



are linearly dependent. This translates into the existence of a-, 

equal to zero, such that R m (\j) ■= YJILidjUia^iXj) = 0. Using (|2.478l), j € 



a^, not all 



x T af 



H m _i and RmiX^-Fj = 0, we get that = a™C/(a m ) tr (A J ) J F i 
equality implies that aj 1 = (since j ^ H m ). Therefore, for every j £ H m _i \ H m , 
the rows U(a ) tr (Xj), for 1 ^ I ^ m — 1, are linearly dependent. This fact can be 
expressed as follows. Let V m be the (m — 1) x m matrix of complex functions with 
rows given by U(a l ) tr , 1 $J I $J m — 1. Then, for every j € K m _i \ H m , the rank of 
V m (Xj) is less than m — 1. Equivalently, that means that, for every j £ K m _i \ H m 
and every minor M of V m of order m — 1 (viewed as a holomorphic function), 
M(X 3 ) 



0. But, using (2.4811 for I 



1 and Lemma 



2.82 



on page 



91 



it is 



then easy to see that every such minor M verifies the assumptions of Lemma |2.80| 
on page 90 Therefore, every minor M of V m of order m — 1 is equal to zero (as a 
holomorphic function), i.e., for every s £ C, the rank of V m (s) is less than m — 1. 
This implies that, for every j € H m „2 \ ^m-i, the rows U(a l ) tr (Xj), 1 ^ I ^ m — 1, 
are linearly dependent. 

Repeating the previous construction, we arrive, in m — 1 steps, at the fact that 
the rank of the row vector U(a 1 ) is less than one, i.e., U{a 1 ) is the zero function. 

for every j ^ 0, contradicting the fact that a 1 



This implies, by (2.478 
is not equal to zero. '!'. 



that a* 



le proof of Theorem 2.79 is complete 



Remark 2.84. The above method can also be used to get other obstructions to 
controllability. For example, it allows us to prove in [91] that, for generic bounded 
open subset £2 £ M 1 with I ^ 2, the steady-state controllability for the heat equation 
with boundary controls dependent only on time does not hold. 



Remark 2.85. The noncontrollability result stated in Theorem 2.79 on page 
is not directly due to the dimension / but to the growth of the eigenvalues of the 
Laplace-Dirichlet operator. It turns out that the growth of the eigenvalues is linked 
to the dimension /. But, even in dimension 1, there are partial differential equations 
for which the growth of the eigenvalues is again too slow to have controllability with 
a finite number of controls. This is, for example, the case for suitable fractional 
powers of the Laplacian in dimension 1 on a finite interval or for the Laplacian on 
the half line. For these cases, one gets again obstruction to null controllability 
with a finite number of controls. These results are due to Sorin Micu and Enrique 
Zuazua. In fact, they have gotten stronger negative results, showing that, for very 
few states the control system can be steered from these states to zero in finite time. 
See |354j for the case where the domain f2 is a half line, |355j for the case of a half 
space, and |356j for a fractional order parabolic equation. 
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2.6. A one-dimensional Schrodinger equation 

Let / be the open interval (-1, 1). For 7 G R, let A 1 : D{A 1 ) C L 2 (I;C) -^ 
L {I\ C) be the operator defined on 

(2.483) D(Ay) := H 2 (I; C) n H$(I; C) 
by 

(2.484) A 7 <p := -ip xx - jxcp. 



In (2.483) and in the following, 

H^(I-C) := {ip€ H\(0,L);C); <p(0) = <p(L)}, 

as usual. We denote by (■, ■) the usual Hermitian scalar product in the Hilbert 
space L 2 (I\ C): 



(2.485) ((p,ip) := / tp(x)ip{x)dx. 



Let us recall that, in (2.485 I and throughout the whole book, z denotes the complex 
conjugate of the complex number z. Note that 

(2.486) V{A 1 ) is dense in L 2 {I; C), 

(2.487) A 1 is closed, 

(2.488) A* = A y , (i.e., A 7 is self-adjoint), 

(2.489) A 7 has compact resolvent. 



Let us recall that (2.4891 means that there exists a real a in the resolvent set of 
Ay such that the operator (aid — Ay) -1 is compact from L 2 (/;C) into L 2 (/;C), 
where Id denotes the identity map on H (see, for example, |267., pages 36 and 
187]). Then (see, for example, [2671 page 277]), the Hilbert space L 2 (/;C) has a 
complete orthonormal system (v^oOfceNUo} of eigenfunctions for the operator A~f. 

where (Aj. 7 ) feeN \ r \ is an increasing sequence of positive real numbers. Let § be 
the unit sphere of L 2 (I;C): 

(2.490) § :={</> G L 2 {I;C); f \<f)(x)\ 2 dx = 1} 

and, for ^ G §, let T§</> be the tangent space to § at cj>: 

(2.491) T S (t> := {$ G L 2 (I; C); »(*, 0) = 0}, 

where, as usual, Stz denotes the real part of the complex number z. 
In this section we consider the following linear control system: 

(2.492) * t = W xx + ijxty + iuxip^y, (t, x) G (0, T) x I, 

(2.493) #(*,-l) = #(t,l) = 0,t£ (0,T), 
where 

(2.494) i>i,-r(t,x) := e _iAl ^Vi,7(«), (*,») e (0,T) x /. 
This is a control system where, at time t G [0, T]: 

- The state is #(£, ■) G L 2 (7; C) with V(t, ■) G T s (V>i, 7 (t, •))■ 

- The control is u(t) G R. 



m<; 
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The physical interest of this linear control system is motivated in Section |4.2.2| 
(see in particular the linear control system (4.87 1-( 4.88[ )) and in Chapter p}n see in 
particular the control system (£') defined on page 261). 
Let us first deal with the Cauchy problem 

(2.495) * t = i^ xx + i-yx9 + iuxip ln , (t, x) g (0, T) x I, 

(2.496) *(«,-l) = *(i,l) =0, te (0,T), 

(2.497) *(0,a;) = * (s), 



where T > 0, u g i^O^) and *° g L 2 (/;C) are given. By ((2 

HA)* = 



-iA, 



Therefore, by Theorem A. 16 



on page 



377 — iA 1 is the infinitesimal generator of 



a strongly continuous group of linear isometries on L (J;C). We denote by S~,(t), 
t g R, this group. 

Our notion of solution to the Cauchy problem ( 2.495 l-( 2.496 )-( 2.497 1 is given 



in the following definition (see Theorem A. 7 



on page 



375). 



Definition 2.86. Let T > 0, u g L l (Q,T) a nd #° g L 2 (J; C). A solution 

* : [0,T] x J -» C to the Cauchy problem {2. 4 9 '5j ) - (2~496\ l - {2. 4 Pfy is the function 

* g C°([0,T];L 2 (/;C)) defined by 

(2.498) <Z>(t) = 5 7 (i)*°+ / S , 7 (i-r)m(T)a;i/.i i7 (r, -)rfr. 

Jo 



Let us now turn to the controllability of our control system (2. 492)- (2. 493 1. 
Let 

(2.499) H% 0) (I;C) := {</> G H 3 (I; C); ^(-1) = ^w(-l) = </-(!) = ^»»(1) = 0}. 

The goal of this section is to prove the following controllability result due to Karine 
Beauchard [40, Theorem 5, page 862]. 

Theorem 2.87. There exists 70 > such that, for every T > 0, for every 
7 g (0, 7o ] 7 for every *° g T<#i, 7 (0, -)nHf 0) (I; C) and for every I- 1 g T s ipi„{T,-)n 
-ff?Q%(I;C), £/iere exists u g L 2 (0,T) smc/i i/iai i/ie solution of the Cauchy problem 



(2.500) 

(2.501) 

(2.502) 

satisfies 

(2.503) 



$ t = ^ xa . + ij X ty + iu(t)xipi t -f, t g (0, T), a; g I, 

*(t l -l) = *(t J l)=0 > t€(0 l T), 

*(0,x) = *°(a;), 16/, 



#(!>) = * 1 (a;), ie/. 

We are also going to see that the conclusion of Theorem |2 . 87| does not hold for 
7 = (as already noted by Pierre Rouchon in [417j ). 
Proof of Theorem [2787) . Let T > 0, 

*° g T s (ih„(Q, ■)) and V 1 g Ts(V>i, 7 (T, ■))■ 



Let u g L 2 (0,T). Let * be the solution of the Cauchy problem ( |2.500[ )-( |2T50T| )- 

(2.502 I. Let us decompose ^{t, ■) in the complete orthonormal system {<Pk,^)k&i\{o} 
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of eigenfunctions for the operator A 1 : 

oo 

fc=i 



07 



Taking the Hermitian product of (2.500) with ifk,-y, one readily gets, using (2.501) 
and integrations by parts, 



(2.504) 

with 

(2.505) 



ijk = -iXk n Vk + ib kn u(t)e 



h n ■= {<Pk,-y,%<pi,-y) e 



-i\± *yt 



Note that (2.5021 is equivalent to 

(2.506) jfr(0) = (*°, (p k „), Vfc £ N \ {0}. 



From (2.5051 and (2.5061 one gets 



(2.507) 



Vk(T) 



-JA fc ~T//, T ,0 



((9°,<Pk„)+ibk„ / ttWe*^-'-* 1 -^**). 



(2.508) fc>7 / " 
'o 



By (2.5071, (2.5031 is equivalent to the following so-called moment problem on u: 

(t)e l{Xk --- Xl -~< )t dt 

= i ((9°, ip kn ) - (9 1 ,<p k „)e *'-' T ) , Vfc e N \ {0}. 

Let us now explain why for 7 = the conclusion of Theorem |2.87| does not 
hold. Indeed, one has 

(2.509) <Pn,o(x) ■= s'm(mrx/2), n £ N \ {0}, if n is even, 

(2.510) <Pn,o(x) ■= cos(nnx/2), n £ N \ {0}, if n is odd. 

In particular, xipi t otpk,o is an odd function if k is odd. Therefore 

bk.o = if fc is odd. 



Hence, by (2.508), if there exists k odd such that 

there is no control u £ L 2 (0,T) such that the solution of the Cauchy problem 
( |2.500[ )-( p^50T| )-( |2.502[ ) (with 7 = 0) satisfies ( |2.503[ ). 

Let us now turn to the case where 7 is small but not 0. Since 'I' is in 

Wi, 7 (o,-)), 

(2.511) SR{^°, ip hy ) = 0. 
Similarly, the fact that 9 1 is in Tg(ipi n (T, ■)) tells us that 

(2.512) 3?((* 1 ,v?i, 7 )e lAl ^ T ) = 0. 

The key ingredient to prove Theorem |2.87| is the following theorem. 



');-: 
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Theorem 2.88. Let (Hi)i^n\{o} be a sequence of real numbers such that 

(2.513) Mi = 0, 

(2.514) there exists p > such that [ii+i — Hi ^ p, V« S N \ {0}. 
Lei T > be such that 



(2.515) 



hm — — < — , 



where, for every x > 0, N(x) is the largest number of \ij 's contained in an interval 
of length x. Then there exists C > such that, for every sequence {ck)ke~N\{o} °f 
complex numbers such that 

(2.516) CiSM, 

(2.517) 



OO 

^|c fc | 2 < oo, 
fc=i 



i/iere exists a (real-valued) function u e L 2 (0,T) smc/i i/iai 
(2.518) / # i| " i fl = Ci,Vl6N\{0}, 



(2.519) 



w(t) 2 di < C 



Em 2 - 
fe=i 



Remark 2.89. Theorem 2.88 is due do Jean-Pierre Kahane 1262, Theorem 
III. 6.1, page 114]; see also [53, pages 341-365] by Arne Beurling. See also, in the 
context of control theory, [4221 Section 3] by David Russell who uses prior works 
|246j by Albert Ingham, |400] by Ray Redheffer and |439j by Laurent Schwartz. 
For a proof of Theorem 2 
or 



see, for example, [282, Sect ion 1 .2.2], [280, Chapter 9] 

have been obtained by 



Chapter II, Section 4]. Improvements of Theorem 



Stephane Jaffard, Marius Tucsnak and Enrique Zuazua in 252, I253J . by Stephane 
Jaffard and Sorin Micu in [251 , by Claudio Baiocchi, Vilmos Komornik and Paola 
Loreti in [27] and by Vilmos Komornik and Paola Loreti in [279 and in [280 
Theorem 9.4, page 177]. 



Note that, by (|2.511| and (|2.512|) 
(2.520) 



i((^°,( / 9i, 7 )-(* 1 ,<^i, 7 )e 



i X i 



Hence, in order to apply Theorem |2.87| to our moment problem, it remains to 
estimate Afe. 7 and 6fc l7 . This is done in the following propositions, due to Karine 
Beauchard. 

Proposition 2.90 ([40, Proposition 41, pages 937-938]). There exist 70 > 
and Co > such that, for every 7 G [—70, 7o] and for every k s N \ {0}, 



TT 2 k 2 



fc, 7 



^ Co 



Proposition 2.91 ([40] Proposition 1, page 860]). There exist 71 > and 
C > such that, for every 7 S (0, 71] and for every even integer k ^ 2, 



3fc, 7 



(-l)5+l8fc 
7T 2 (fc 2 -l) 2 



< 



Cj 

k 3 ' 
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<)<) 



and for every odd integer k ^ 3, 



bk n ~ 7 



2(-l)^(fc 2 + l) 



7T 4 fc(fc 2 -l) 5 



< 



k 3 



It is a classical result that 



+oo 



v : = ^2 d fc^fe.7 e ^fo)(^; c ) 



if and only if 



fc=i 



+oo 



E fc6 i^ 



< +00. 



fe=l 



Hence, Theorem 2.87 readily follows from Theorem 2.88 applied to the moment 



problem (2.508) with the help of Proposition 2.90 and Proposition 2.91 



2.7. Singular optimal control: A linear 1-D parabolic-hyperbolic 

example 

In this section, which is borrowed from our joint work }124j with Sergio Guer- 
rero, we consider the problem of the null controllability of a family of 1-D linear 
parabolic control equations depending on two parameters, namely the viscosity and 
the coefficient of the transport term. We study the dependence, with respect to 
these parameters and the time of controllability, of the norm of the optimal con- 
trols. In particular, we give estimates on the optimal control as the viscosity tends 



to 0. Let (e,T,L,M) G (0,+oo) 
control system 



We consider the following parabolic linear 



(2.521) 
(2.522) 



yt-ey xx + My x = 0, te (0,T),i6 (0,L), 
y(t,0) = u(t),y(t,L) = 0,te (0,T), 



where, at time t, the state is y(t, •) : (0,L) 
This section is organized as follows: 



and the control is u(t) G 



In Section 2.7.1 we study the Cauchy problem associated to the control 
system (2.521 )-( 2.522 |. To achieve this goal, we use the abstract framework 



detailed in Section 12.31 



In Section 2.7.2 we study the null controllability of system (2.521 )-(2. 522 ) 



and the dependence of the cost of the null controllability of system (2.521 ) 



(2.522) with respect to the four parameters s, T, L, M. 



2.7.1. Well-posedness of the Cauchy problem. This section concerns the 
following Cauchy problem: 

(2.523) yt-ey xx + My x = 0, te (0,T), x € (0,L), 

(2.524) y(t, 0) = u(t), y(t, L) = 0, t e (0, T), 

(2.525) !/ (0,a;)=/(j;) 1 ie(0,L), 
Let us recall that 

H-\Q,L) := fe; £ G L 2 (0,L)} C V'(0,L), 



Kill 
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where 2?'(0,L) denotes the set of distributions on (0,L). Let us denote by J the 
following linear map 

(2.526) H 'J^ ^(O,*) 

f h-> a, 

where H$(0,L) := {/? € iT^O.L); /?(0) = /?(L) = 0} and a G H&(0,L) is such that 

-a xx = fmV'{0,L). 
The vector space H~ (0,L) is equipped with the following scalar product 

(2.527) (f,9) H -Ho,L) = I (Jf) x (Jg) x dx, W(f,g) G fr^O.L) x fT^O.L). 

Jo 

Equipped with this scalar product H _1 (0, -L) is a Hilbert space and J is a surjective 
isometry between H" 1 ^, L) and Hq (0, L) provided that Hq (0, L) is equipped with 
the scalar product 

(a,P)m(o,L) = I a x /3 x dx, V(o,/9) € ^(^L) x ^(0,i). 

Jo 

Note that, by an integration by parts, it follows from (2.527) that 

(2.528) (f,g) H -i(o,L) = I (Jf)gdx, V(/, 9 ) e H- l (0,L) x L 2 (0,L). 

Jo 

Let A be the unbounded linear operator on JJ _1 (0, L) defined by 

(2.529) ^^^(O.L), 

(2.530) Af:=ef xx -Mf x yfeD(A). 

Then the operator is densely defined and closed. Let / G D(A) H H 2 (0,L) and 
a = J/. One has, using (2.528) and integrations by parts, 

(Af,f) H -i (0iL) = / {ef xx -Mf x )adx 



(2.531) 



L ,-L 

2, 



£ / / dx - Ml a xx a x dx 



-e / f z dx 



M 



(a x (L) 2 -a x (0) 2 ). 



Since a G 7Jg(0,L) f~l H 2 (0,L) there exists £ G [0,L] such that a x (£) = 0. Hence, 
for every s € [0,L], 



(2.532) a x (s) 2 < 2 / Ka^cta < 



n 



|M| + 1 7 



fdx 



IMI + 1 



cCcfec. 



n 



From ( |2.531| and (|2_532j, one gets, for every / G D(A) H ff 2 (0, L) 

i|ii.£,)<|M| J uc x u^ — \ivi\ IU ll_H--i(o,L) 

r-i 



(2..V«) i l/./)„ !,„.„ :' S |M|JM±1 r^ da . = | M |lM+ 1 n.ii^ 

£ Jo £ 



Let Id//-i(o.L) be the identity map from H (0,L) into itself. By the density of 
D(A) D H 2 (0,L) in 13(A) for the graph norm of A (see page |374[) and (|2.533|, the 



operator A — ddji-itp,L) is dissipative (see Definition A. 2 
large enough. 



on page 



373 ) for C > 
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Concerning the adjoint A* of A, one easily checks that 
(2.534) 

D(A*) = {fe H l (0, L); -e/(0) + M(Jf) x (0) = -ef(L) + M(Jf) x (L) = 0}, 

(2.535) A*f = J-\-ef + M(Jf) x ), 

(2.536) A* is closed and densely defined. 

Let / e D(A*) n H 2 {0,L) and a := Jf. One has, using ( |2.528| and ( |2.535| , 

(A*fJ) H - H0 ,L) = [ (sf + M(Jf) x )fdx 



(2.537) 



L r L 

2, 



. 



z I f 2 dx 

'0 



f dx — Ml a xx a x dx 



M 



(a x (L) 2 - a x (0) 2 ). 



From (2.532 I and (2.537), one gets that (^4 — CId ff -i( n)*i as A — CId H -i(n L \, is 
dissipative for C > large enough. Let C > be such that A — CId#-i( ,L) and 



(^4— Cld^-won)* are dissipative. By Theorem A. 10 



on page 



375 



A-Cld H - 



i(0,i) 



is the infinitesimal generator of a strongly continuous semigroup Sc{t), t 6 [0, +oo) 
of continuous linear operators on H~ 1 (0, L). For t € [0,+oo), let 

S(t) : H -> H 

f ^ S(t)f:=e ct S c (t)f. 

One easily checks that S(t), t G [0,+oo), is a strongly continuous semigroup of 
continuous linear operators on //^(OjL) and that the infinitesimal generator (see 
Definition A. 9 on page 3751 of this semigroup is A. 

Let us now turn to the operator B. We first take U := M. In order to motivate 
our definition of B, let us point out that, straightforward integrations by parts show 
that, if f(L) = 0, then 

(2.538) (ef xx - Mf x ,g) H - HOtL) = sf(0)(Jg) x (0) 

+ (f,A*g) H -i {0tL) , V/ e H\0,L), V ff e D(A*). 
Looking at Definition 2.36| on page |53[ one sees that if 

2 /eC 1 ([0,T];ff- 1 (0,L))nC o ([0,T];ir 1 (0,L)) 



is a classical solution of ( |2.523 ) and (2.524) for some u : [0,T] — > ] 
^([O,^;^- 1 ) n C°([0,T];D(A)) is a solution of 

z = A* z, 

we must have 

(2.539) (ef xx - Mf x ,g) H - HOiL) - (f,A*g) H - HOtL) = f(0)Bg, 

with 

/ := 2/(0), g := z(0). 



and if z € 



Hence, from (2.5381 and (2.5391, one sees that the definition of B must be the 
following: 

R -» D(A*)' 

u .-> {g e D(A*) h-> eu(Jg) x (0)). 



102 
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Clearly, the linear map B is well denned and continuous from K into D(A*)'. Let 
us check the regularity property (2.199). Let T > and z° G D(A*) and let 
zeC 1 ([0,T]; J ff- 1 (0,L))nC°([0,T];Li(A*)) be defined by 

(2.540) z(t) := S(t)*z°, Vt G [0, T\. 

Let V3G C 1 ([0,T];i7 1 (0,L))nC°([0,T]; J ff 3 (0,L)) be defined by 

(2.541) (p(t) = Jz(t), V*G [0,T]. 
Then, with <p(t,x) := i/?(t)(a;), 

(2.542) yt = £ fe + M fe te(0 1 T),a;6 (0,L), 

(2.543) p(i, 0) = <p(t, L) = 0, Vt € [0, T]. 



Moreover, the inequality in the regularity property (2.1991 is equivalent to 

(2.544) f \^ x (t,0)\ 2 dt ^ % f \<p x {0,x)\ 2 dx. 

Jo £ Jo 



Let us prove inequality (2.544). We multiply (2.542) by — <p xx . Using (2.543) 
and integrations by parts, we get 



(2.545) — J \<p x {t,x)\ 2 dx 



s I \ip xx (t,x)\ dx 

'0 

M 



(\<p x (t,L)\ 2 -\<p a ,(t,0)\ 2 ),Vte[0,T\. 



Using (2.532) with a := <p(t, ■), one has 



(2.546) |^(i,s)| 2 < 



|m| + u 



ip xx {t,x)\ 2 dx-\ / \<p x (t, x)\ 2 dx. 



Using (2.545) and (2.5461, we have (discuss on the sign of M) 

(2.547) 



d 

d7 

with 

(2.548) 



\ip x (t,x)\ 2 dx < -c\ \ \ip xx {t,x)\ 2 dx + c 2 \(p x {t,x)\ 2 dx, Vt G [0,T], 



> 0. 



Ci := - > 0, c 2 := 



|M|(|M| + 1) 
2e 



From (2.5471 and (2.5481, one gets 

rL 



(2.549) 
(2.550) 



\ip x (t,x)\ 2 dx < e C2T / |^(0, x)\ 2 dx, V* G [0,7*], 
o Jo 



T r L 



c 2 T 



|y xx (<,a:)| dxdi < — 
o ^o c i Jo 



|<y9 x (0,o;)| 2 da;. 



From ([2.546), (|2.549| and (|2.550j), one gets (|2.544|) with 

e 



Ct 



T 



\M1±1\ ,c 2 T 



M\m\ + i) 

Finally, using Definition |2.36| on page [53] together with Theorem 2.37| on page |53| 
one gets the definition of a solution to the Cauchy problem (2.523), (2.5241 and 
(2.525 I, together with the existence and uniqueness of the solution to this problem. 
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ID:! 



Moreover, proceeding as in Section |2.3.3.1| and Section |2.3.3.2| one can easily 
check that, if y° g H 2 (0, L) and u g H 2 (0, T) are such that 

y°(0) = u(0)&ndy(L)=0, 



then the solution y to the Cauchy problem (2.523 I, (2.524 I and (2.525 I is such that 



2 /eC 1 ([0,T];L 2 (0,L))nC°([0,T];7J 2 (0,L)) 



and satisfies (2.523), (2.524) and (2.5251 in the usual senses 



2.7.2. Null controllability and its cost. The control system (2.521 )-(2.522 ) 



is null controllable for every time T > 0. Let us recall (see Definition 2.39 
page 55 1 that this means that, for every y° g JJ _1 (0,L) and for ev ery (e , T, M ) g 
(0,+oo ) 2 x K, there exists u g L 2 (0,T) such that the solution of ( |2.523| -( |2~524"1 )- 
(2.5251 satisfies y(T,-) = 0. This controllability result is due to Hector Fattorini 
and David Russell [162, Theorem 3.3]; see also Oleg Imanuvilov [2421 [243] , Andrei 
Fursikov and Oleg Imanuvilov |186j . and Gilles Lebeau and Luc Robbiano |307j for 
parabolic control systems in dimension larger than 1. (The last reference does not 
explicitly deal with transport terms; but the proof of [307 can perhaps be adapted 
to treat these terms.) The proof in [186] is the one we have given for Theorem 2.66 



on page |79[ This null controllability result also follows from Section |2.7.2.2| below 
if T > is large enough. 

For y° g i7 _1 (0,L), we denote by U(e, T, L, M, y ) the set of controls u g 
L 2 (0,T) such that the corresponding solution of ( |2.523[ )-( [2~524| -( |2.525| satisfies 
y(T, ■) = 0. Next, we define the quantity which measures the cost of the null 



controllability for system ( |2.52l[ )-( |2.522| : 

(2.551) K(e,T,L,M):= sup { inf{||u|| L2(0)T) 



sup 

lH- 1 (0,L) i 



eU(s,T,L,M,y°)}}. 



Remark 2.92. One easily checks th at U(e ,T,L,M,y°) is a closed affine sub- 
space of L 2 (0,T). Hence the infimum in (2.5511 is achieved. 



Remark 2.93. In [124], we have in fact considered, instead of K defined by 



(2.551 1, the quantity 



(2.552) K*(e,T,L,M):= sup {inf{|| u || La(0iT) : u g C/(e,T, L, M, y )} }. 

ll2/°lll,2(0.l.)O 



But the proofs given here are (essentially) the same as the ones given in [124j ; see 
also Remark [2~98l 

In this section our goal is to give estimates on K(e,T, L, M), in particular as 
£ — > + . Let us point out that simple scaling arguments lead to the relations 

M 



K(e, T, L, M) = a 1/4 K [e,aT, a 1/2 L, — 



1/2 



(2.553) 

and 

(2.554) 

for every (a, e, T, L, M) g (0, +oo) 4 x K. 

In order to understand the behavior of K{e,T,L,M) as s — ► + , it is natural 



K(e, T, L,M) = a 3/4 K{a £l T, a 1/2 L, a 1/2 M) , 



to look at the limits of trajectories of the control system (2.521 )-( 2.522 1 as e — > 



This is done in the following proposition, proved in [124 
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Proposition 2.94. Let (T,L,M) be given in (0, +oo) 2 x K* and let y° e 
L 2 (0,L). Let (e n )„gN be a sequence of positive real numbers which tends to as 
n — » +oo. Let (u n )„gN be a sequence of functions in L 2 (0,T) such that, for some 
u£L 2 {0,T), 

(2.555) u n converges weakly to u in L (0,T) as n — > +oo. 
For nGH, let us denote by y n £ C°([0,T]; i? _1 (0, L)) the solution of 

(2.556) y n t-£nynxx + My nx = 0, (t,x) € (0,T)x (0,L), 

(2.557) y n {t, 0) = u n (t), y n {t, L) = 0, t e (0, T), 

(2.558) y n (0,x) = y°(x),xS(0,L). 
For M > 0, let y G C°([0, T]; L 2 (0, L)) &e i/ie solution of 

' y t + My x = 0, (t,x)€(0,T)x(0,L), 

(2.559) < y(t,0) =u(t), te(0,T), 

, j/(0,x)=y o ( a ;), ie(0,L), 
and, for M < 0, let y G C°([0, T]; L 2 (0, L)) &e i/ie solution of 
' y t + My x = 0, (t,x)€(0,T)x(0,L), 
< y{t,L) = 0, t€(0,T), 

. i/(0,aO = y°(j:), ze(0,L). 



(2.560) 
Then 



y n —*■ y weakly in L ((0,T) x (0,L)) as n 



For the definition, existence and uniqueness of solutions to the Cauchy problems 

on page 



(2.5591 and (2.560), see Definition 2.1 



25 and Theorem 2.4 



on page 



27 



Definition 2.1 and Theorem 2.4 which deal with the case M = 1, can be easily 
adapted to the case M > and M < 0. 

It follows directly from Proposition |2.94"] and the first proof of Theorem |2.6| on 
page 

(2.561 



29]that, for every (T,L,M) with T < L/\M\, one has 

oo. 



lim K(e,T,L,M) 



Our first main result gives an estimate for the rate of convergence in (2.561 1. 

Theorem 2.95. There exists C > such that, for every (e,T,L) e (0,+oo) 3 , 
one has, for every M > 0, 



(2.562) K(e, T, L, M) > O® T r5/2 ^ 5/2 »l> ( ~ ' L ~ ! } ' ' 



L 5/2 M 5/2 

r5/2 



— ■ 

2e' 



^ 2 eT 



and, /or every M < 0, 

(2.563) Jf( e> r,i,ilO>qa l5/2|m|5/2 expf LJ(2L-T|M|)- — 

1 H ! ■ 

+ £ 5/2 

The proof of this theorem is given in Section |2.7.2.1| It relies on harmonic 
analysis. 

Concerning upper bounds of K(e, T, L, M), let us point out that 



2.7. SINGULAR OPTIMAL CONTROL 



LOT. 



If M > and T > L/M, the control u := steers the control system 
(|2.559[) (where the state is y(t, ■) G L 2 (0, L) and the control is u(t) £ K) 



from any state to in time T. (This means that, if M > 0, T > L/M 
and w = 0, then, for the function y defined in Proposition 2.94 y(T, ■) = 
whatever y° £ L 2 (0, L) is.) 
- If M < and T > L/|M|, then, for the function y defined in Proposition 
whatever y° £ L 2 (0,L) is. 



2.94 



y(T, 



This could lead us to hope that, for every (T,L,M) £ (0,+oo) 

L/\M\, 

(2.564) K{e, T, L, M) -* as e -> 0+. 



with T > 



As shown by Theorem |2.95| this turns out to be false for M < and T £ 
(L/\M\,2L/\M\). Our next theorem shows that ( |2.564[ ) holds if T\M\/L is large 
enough. 

Theorem 2.96. Let a, A, b and B be the four positive constants 

(2.565) a := 4.3, A := 2.61, b := 57.2, B := 18.1. 

There exists C\ > suc/i i/jaf, /or every (e, T, L) € (0, +oo) 3 and /or every M £M* 
with 



(2.566) 



\M\L 



>qs-. 



- IfM>0and 



(2.567) 



T^ a 



M' 



then 



(2.568) K(s, T, L, M) < qip- 3/2 L 1/2 Af exp 

- If M < and 

(2.569) T > 

i/ten 

(2.570) K(s, T, L, A/) < Qif^M 1 ^ 

exp - 



L 2 / 3 (2TM 



2eT \ 4 V 3L 



L 

Ml 



L 2 / 3 /2TIMI 



2eT \ 4 V 3L 



B- 



.TIMI 



The proof of this theorem is given in Section |2.7.2.2| It relies on a decay 
estimate for the solution of (2.521 )-( 2.522 I when u = and a Carleman estimate 



for the solutions of the adjoint system of (2.521 )-(2.522 ) 



REMARK 2.97. Theorem |2.95| and Theorem |2.96| have been generalized in part 
by Sergio Guerrero and Gilles Lebeau in }209j to higher dimensions and to the case 
where M may depend on t and x. 
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2.7.2.1. Proof of Theorem \2.95\ Let (e, T, L, M) G (0, +oo) 3 x R*. For the sake 
of simplicity, throughout this section, 7^ stands for K(e,T 1 L, M). Let us define 
2 / GL 2 (0,L)by 

(i/ x /7nr\ f Mx\ 

y u (x) :=sin^— Jexpl — J , a; £ (0,L). 

Let us estimate ||j/ ||jj-i(o i)- Let z° := Jy . One easily gets 
1 1 ( (M i^ 



(2.571) z y \x) 



2« (M ITT 

2e + ~L 



exp 



2e L 



1 



M i?r 



v 2 ex P M o ] x ) + aix + a , 

2« /A/ wrV \\2e L 

2e ~ ~L 



with 

(2.572) 

(2.573) 



irM 



1 



a := 



ax :-- 



\1^ + 1?) 
B ttM 1 (ML\ 



L eL / M 2 ^ 2 x - 



4e 2 L 2 



From (2.571 1, (2.572 I, (2.573 1, one gets the existence of C-2 > such that, for every 
(e,T,L,M) G (0,+oo) 3 xE*, 



(2.574) 



(2.575) 



( LM\ 
3 exp I I 

|y°lllr-i(o l£ )<%^» M rA ifM>0, 



d M 3 e 



rll^-Mo.D < % 



L 3 M 3 
1 



M 3 



, if M < 0. 



L 3 |M| S 



Let w G f/(e, T, L, M, g/ ) be such that (see Remark 



2.92 



on page 



1031 



\\u\\lho,t) = min {IMU 2 (o,T) : ue U{e,T,L,M,y )}. 



In particular, the solution of (2.523 )-(2.524 )-(2.525 I satisfies 

(2.576) y(T,-) = 0, 

and we have 

(2-577) IMU»(o,t) < K \\y°\\H-Ho,Ly 

Let tp G C 2 ([0,T] x [0,L]) be such that 



(2.578) 



<Pt +£<Pxx + Mtp x = 0, V(t, a:) G [0, T] x [0, L], 
<p(t,0) = <fi{t,L) = 0, Vie [0,T]. 



2.7. SINGULAR OPTIMAL CONTROL 

Let z E C 2 ([0,T];L 2 (0,L)) and z T € L 2 {0,L) be defined by 

(2.579) z(t):= J" 1 ^, •)), Vi G [0, T], 

(2.580) z T :=z(T). 
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Using (2.578), one gets 

(2.581) z(t) = S*(T-t)z T , Vie [0,T] 

on page 



2.36 



From Definition 



(2.581 1, one gets that 



53 for r := T, (2.523), (2.524), (2.525), (2.5801 and 



(y(T, ■),z 1 ) ff -i (0 ,£) - (y u , «(0)) ff -i(o,L) = £ / «(*)(^(*))x(t, 0)dt, 

Jo 



which, together with (|2_528j), (|2_576j), ( |2.579| and ( |2.580| , leads to 
(2.582) -/ y°(x)tp(0,x)dx = e u(t)(p x (t,0)dt. 



Let fc e N \ {0}. Let us define ip : [0,T] x [0,L] — > K by requiring, for every 
(t,x)e[0,T]x[0,L], 



, Mx\ / kirx\ 
<p[t, x) := exp [ - — I sin I — I exp 



M 2 k 2 ir 2 e 



4c 



L 2 



One easily checks that (2.5781 holds. Hence, by (2.5821, one has 
(2.583) 



kire 



u(t) exp 



o 



M 2 k 2 n 2 e 



it 



V- 



t dt 



Let us now define a function v 

r T/2 



by 



(2.584) 



v{s) :-- 



T/2 



U\ t + 



'ttx\ ( kirx . , 
Mil | — ) sm ) ax. 



dt, s e 



From ( |2.583| and fl2.584| , we get 

'M 2 k 2 7r 2 e 



(2.585) 

and 

(2.586) 



4c 



V- 



iffceN\{0,l} 



M 2 T^e 
17 + U 



27T£ 



exp 



/M 2 T 7T 2 £T 
l^£ _ + ^L 2 " 



From ( |2.577| and ( |2.584| , we get 

rT 



\v(s)\ < exp 



T|Im(.s) 



I \u(t)\dt^ KT l/2 exp( 



l/2„„„/^ T l Im ( S )l \ „M|, 

2/ llff-Ho.i) 
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which, together with (2.574) and (2.5751, gives the existence of C3 > such that, 
for every (e,T,L,M) £ (0,+oo) 3 x K*, 



(2.587) \v(s)\ < qg<e 3/2 T 1 / 2 Ar 3 / 2 - 



exp 



(LM T\Im{s) 



V 2 e 



r 3/2 



(2.588) 



\v(s)\ < q^e 3 l 2 T l l 2 \M\- 3 ' 2 - 



1 + 
exp 



L 3 / 2 M 3 / 2 
( T\Jm(a)\ 



=■3/2 



, if M > 0, 



if M < 0. 



L3/2IA/I3/2 



Let us define a map / : C — > C by 

,(.):.. (i^£!),. 6 c 

We readily have that / is an entire function satisfying 
(2.589) /(& fe ) = 0, * G N \ {0, 1}, 

with 



(2.590) 



j 2Af" 



4fc 2 7rV 

L 2 



/eeN\{0}. 



Additionally, (|2_587j) and ( |2.588| translate into 
(2.591) 



l/WK^^/ 2 ^ 



_ exp I — 1 exp I 



r-3/2 



(2.592) |/(s)| < q3]ft:e 3/2 T 1/2 M- 3/2 - 



1 + 
exp 



£3/2^3/2 

T|Im(s) - M 2 \ 
8e 



r-3/2 



if M > 0, 



, if M < 0. 



1 



L 3 / 2 |M| 3 / 2 



Let (a^)^ e N be the sequence of zeros of / in C+ := {s 6 C : Im(s) > 0}, each 
zero being repeated according to its multiplicity. By the classical representation of 
entire functions of exponential type in C+ (see, for example, |281l Theorem page 
56]), H2.591D and (|2.592|, one has for s = x x + ix 2 € C+, 



(2.593) 



ln|/(»)l=X> 



1=1 



s — an 



s — ag 



ax 2 



x 2 /•+ 00 ln|/(r)| 



dr. 



where a is a real number independent of s such that 

T 



(2.594) 



<7^ 



8c 



Note that, by ( |2.586| and (|2_590j), 
(2.595) f {bl) = v UMl + ^ 



L 2 ( (M 2 

"2^ eXpf ' 



8e ' 2L 2 ) 
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By ( [27589] ), {b k ; k g N \ {0, 1}} C {a e ; £ g N}. Hence 



(2.596) 



Vln 



h - ae 



b\ - at 



< 



k=2 



0\ ~ k 



h - b k 



(recall that Im(a^) > for every £ g N). 

Let us estimate Iq from above. We have 



oo 



{k 2 - l)ir 2 e 2 /L 2 



with 



J ° f^ 2 h \M 2 + (k 2 + l)TT 2 e 2 /L 2 



222 



< Jn 



Using the change of variable 



dx. 



ire 

T = — ; :X 



and an integration by parts, we get 



Jo 



L\M\ 

2ire 



-2 In 



-2 In 



In 



L\M] 



1 + T ; 



L\M{ 



(It 



2L\M\ 



,l+(tf) 2 . 



ITS J 2w £ 1 + T 2 

L|M| 



rfr 



2L\M\ (-K ( 2tts 

arctan — ; 

ire \2 \L\M 



,l+(ff) 
Hence, there exists C4 > such that, for every (e, L, M) g (0, +00 

(2.597) 



L\M\ ( L\M 

IoK. !— ^ + 41n( 1 



0& 



Let us now get an upper bound for 



J, 



MM f +00 ln\f(r)\ 



dr. 



Using (2.591 1 and (2.592 ), we get, after straightforward computations, the existence 
of C 5 > such that, for every (e, T, L, M) g (0, +00) 3 x K*, 



(2.598) 



(2.599) 



LM TM 2 1 , I K 2 s 3 TM~ 3 . 
Ji < — + -^— + 7T In I 5— I + % if M > 0, 



2.5 



TM 2 1 



8e 2 



X 2 e 3 T|M| 

V + L 3 |M| 3 J 



L 3 M 3 
\ 



qg, ifM<0. 



Theore m |2.95| th en fol lo ws from ( |2.590|, ([2~593J ) applied with s = bi, ( |2.594| , 



( [27595] ), ( [2~596] , ( [2~597] , ( [27598] ) and ( |2.599| 
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2.7.2.2. Proof of Theorem \2.96] on page \105\ We only treat the case where 

(2.600) M > 0. 

(The case M < can be treated in a similar way; see [124] .) Le t (e, T , L, M) G 
(0 + oo) 4 . Considering Theorem 2.44 on page 56 together with (2.5401, (2.5411, 



(|2.542| and (2.5421, we consider the following partial differential equation: 

ft ~ £Vxx - M<p x = 0, (t, x) G (0, T) x (0, L), 

<p(t,0)=<p(t,L)=0,t<= (0,T), 

ip(0,x) = <p°(x), xe (0,L). 



(2.601) 
(2.602) 
(2.603) 



By Theorem 2.44 in order to prove (2.5681, it suffices to prove the following ob- 
servability inequality. Assume that (2.5661 and (2.5671 hold. Then, for every 
if G ffo(0, L), the solution ip of (|2.601 1-(|2.602|)-(|2.603| satisfies 



(2.604) / \<p{T,x)\ 2 dx < Cgp^LM 2 
Jo 



x exp 



L 2 I 3 (2TM 



eT \ 4 V 3L 




<p x (t,0)\ 2 dt. 



Remark 2.98. Concerning K* defined by (2.5521, one can prove that it is the 
infimum of the set of C > such that 



(2.605) 



<p{T,x)\ 2 dx^Ce 2 / \ifi x {t,0)\ 2 dt,\/ip° e H^{0,L)nH 2 {0,L). 



This result does not follow directly from Theorem |2.44| on page [56] since the lin- 
ear map Tt'- u i— > y(T, •) where y : (0,T) x (0,L) — » M. is the solution of the 
Cauchy problem (2.523), (2.5241 and (2.5251 with y := is an unbounded linear 
operator (from a subspace of) L 2 (0,T) into L 2 (0,L). However, one can adapt the 
proof of Theorem |2.44 on page [56] to treat this unbounded case by noticing that in 
Lemma |2.48| on page |58| one does not require C3 to be a continuous linear operator: 
It suffices that C3 is a closed and densely defined linear operator. 



In order to prove the observability inequality (2.6041, we first prove decay 
estimates for the solution of (|2.601|-(|2.602|)-(|2.603|. 



Lemma 2.99. Let r G (L/M, +00). Then, for every cp° G L 2 (0,L), the weak 

{Mt-L) 2 " 



solution of \2.601\ l- lfiJ0ty - l2.60Sfy satisfies 
(2.606) 



llv(T,-)lli"(0,. 



L 2 



exp 



11/11? 



Proof of Lemma 12.991 Let us first consider the solution 

^GC°([0,r];L 2 (K)) 
of the following system: 

' !p t - eip xx - Mip x = 0, (t,x) G (0,t) x (-00, +00), 
1^(0, ar)| ifxG(0,L), 



^(0,x) 







otherwise 
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Then, by the maximum principle for parabolic equations (see for example [292 
Chapter 1, Section 2]), we know that 



(2.607) 



\<p(t,x)\ ^ <p(t,x), V(t,a;) G (0,r] x (0,L). 



It is well known that the solution ip is given in terms of the fundamental solution 
of the heat equation by 

~, ^ 1 f L ( (x + Mt-y) 2 \ , , N1 
V(t,x) = -. ,..,, / exp (- y - - y) ) \<p(0,y)\dy. 



2(erri)i/2 J Q 



4et 



(Write ip(t,x) = ip(et,x + Mt) = i/)(t,£), with ip T — ip^ = and see, for example, 
|475[ (5.9)-(5.10), page 217].) Now, we readily estimate the exponential term by 
its L°° — norm and we deduce, provided that r > L/M, that 



\<p(r,x)\ < 



2(£7TT) 1 /2 



exp 



(Mt- L)' 
Aer 



llv(0,OIUi(o,i;),Va:€(O l L) > 



which, together with (2.607), implies Lemma 2.99 



We now establish a similar decay estimate but for the T^Q-norm. Our goal is to 
deduce from Lemma |2.99| the following lemma. 

Lemma 2.100. Let r\ > 0. Then there exists C > such that, for every 
(e,r,L,M) G (0,+oo) 4 such that 



(2.608) 
(2.609) 



tM 
LM ^ e, 



and for every <p° G L 2 (0, L), the weak solution of (2.601)-(2.602)-(2.60S) verifies 
(2.610) 



\\^(r,-)\\i H0 , L) ^c 



LM 6 



exp 



(Mt-LY J 2 



2st 



Proof of Lemma |2.100[ For the moment being, let us assume that the 
following lemma holds. 

Lemma 2.101. For every (e,r, L, M) G (0,+oo) 4 and for every tp° G L 2 (0,L), 
the weak solution of \2. 601\ )- (2. 60ty - \2.603$ verifies 

' 1 rAf 4 ' 



(2.611) 

Let 
(2.612) 



\Wx{t,-)\\l*(0,. 



^ 



ST 



l^°llia(0,i)- 



n := r 



From (2.6081, (2.6091 and (2.612) 



ti > 



rje 
2M 2 ' 



L 

M' 



This inequality allows to apply Lemma |2.99| with r := T\. One gets 



(2.613) 



Mn, Oll^co, 



i 2 



4£7rri 



exp 



(Mtj - L) ; 

2£Ti 



„0 II 2 



V IIl 2 (o,z,)- 
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Let us now apply Lemma 2.101 with ip := <£>(ti, ■) and r := r — T\. One gets 
(2.614) ||^(r, Olli^o.L) < (^3^) + (T " £ T 3 l)M4 ) ll^(n, Oll!^)- 



From ( |2.613[ ) and ( |2.614[ ), we have 
(2.615) • '• ' 2 

with 



ll</>*0v)llz,= (0£) < ^II^( T 1,-)II^(0,L). 



(2.616) 
Note that 



I? 



1 



(r-n)M 4 \ L 2 / (Mn-L) 2 
6XP ^~ 



e(r — ri) e 3 7 4£7tti 

{Mt - L) 2 (Mn - L) 2 ry 



$: 



£T 



en 



2' 



1 



e(r - n) 



{t-t 1 )M a \ L 2 l ( 2 , v\ LM 3 



4ettti 4ir \r) 2/ e 



which, together with (2.615) and (2.6161, gives (2.6101 for C > large enough. 

It remains to prove Lemma |2. 101 Without loss of generality, we may assume 
ip° £ ^(0, L) n iJ 2 (0, L). Then 

^GC ([0,T];7J 2 (0,L))nC 1 ([0,r];L 2 (0,L)), 

which is a sufficient regularity to perform the following computations. We first mul- 
tiply (|2.601| by lip and integrate on [0,£]. Using an integration by parts together 
with (2.602), one gets that 

(2.617) — / p 2 dx + 2e ip 2 x dx = 0. 



We then multiply (2.601) by —2ip xx and integrate on [0,L]. Using an integration 
by parts together with (2.6021, one gets that 



(2.618) 



d 

d7 



p x dx + 2e ft x dx = Mip x (t, L) 2 - Mip x (t, Of 



Proceeding as in the proof of (2.532), we get 
(2.619) 



IIVa:(* ) -)ll£°°(0,i) 



$: 



M 



vlxdx ■ 



M 



ipldx. 



Using (2.602), we get 

!' L 
(2.620) 



ipldx 



ip xx ipdx < 



M 2 J 



V xx dx + 



M 



2 i-L 



4e 2 



ip dx. 



From ( |2.617| ), ( |2.618| ), (|2_619| and ( |2.620[ ), we have 

M 4 r L 



(2.621) 



d 

d7 



ip x dx^ 



4e 3 7 



M 4 

tp 2 dx^ -3 h°\\ 2 mo,Ly 



4e 3 



Integrating this inequality on [t, r], we get 



(2.622) 



Af 4 



tp x (r,x) dx^ J <p x (t,x) dx+{T-t) — \\tp || L 2 (0L) 
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Integrating (2.617) on [0,r], we have 

(2.623) 2e [ [ <p 2 x dxdt < ||p ||£»(o, 



Finally, integrating (2.6221 on [0,r] and using (2.6231, we get 

1 tM 4 ' 



<p x (r,x) dx < 



2er 



II 2 



+ ip- J iipiiwj 



This concludes the proof of Lemma |2.101| and therefore also the proof of Lemma 
IzHOOl ■ 



We now establish, as in Section |2.5.2[ a Carleman inequality. Let us first 
perform a change of variables in order to restrict ourselves to the case where e = 
L = l: 



(2.624) 



t = et/L 2 , 
x = x/L. 



In the new variables, we have, with tp(t,x) '■= ip(t,x), 

f <Pt-<P53-e- 1 MLfe = 0, {t,x)e{0,eT/L 2 )x{0,l), 
{ <p(t,0) =<p(t, 1)=0, te(0,eT/L 2 ). 



(2.625) 

Let 
(2.626) 

(2.627) 



M : 
f 



ML 

e 
eT 

L 2 ' 



Then (|2.566l and (2.567) become, respectively, 



(2.628) 
(2.629) 



MT > a. 



Let us define a weight function (compare with (2.408) coming from [186 ), 
(2.630) 



a(t,x) 



(3(x 



^,(t,x)e(0,T)x(0,l), 



where Sj (3 G C 2 ([0, 1]) will be chosen below. We also introduce the function 



if) := e a if. 



This function verifies that 

(2.631) 

with 

Pi ■= i>xx + a~if) + Ma x if> - app, 

P 2 :=-ipt + 2a s if) x +Mip^, 

P 3 := -a xx ip; 
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compare with ( 2.413 1, ( 2.414 1 and ( 2.415 1. As in Section 2.5.2 we take the L 2 -norm 
in identity (2.631 ) and then expand the double product 

(2.632) \\Pi\\h iQ) + \\P2\\h {Q) +2(P 1 ,P 2 ) L2{Q) = \\P 3 \\ 2 L2{Q} , 

where Q stands for the open set (0,T) x (0, 1). 

Let us compute 2(P 1; P2)l 2 (q)- Let us first compute the terms concerning ipxx- 
We have 

1 



(fe)V^)L 2 (Q) = ^ / \ih(T,x)\ dx 



a 5 (t,O)|-05(*,O)| 2 )di 



Moreover, 

2(fe,a^)£=(Q)= / (c^(M)|<fe(M)l ' ""»••"'"'-* 
Jo 

Finally, 



a%x\ipx\ dxdt. 



M(fe,Vx)^ (Q ) = (M/2) / {\^{t,l)\-\MtM)dt. 

Jo 
As long as the term a~ip is concerned, we first have 



-(a 5 V,^)z,=(Q) = // "xaxdV'l dxdt-- a^(T,x]\ip(0,x)\ dx. 



2(a s ip,axi>x) L 2( Q) = -3 // a S £a 2 |V>| dxdt 



Next, 



Finally, 

M(a~ip,ipx) L 2 {Q) = -M / / a^as|V'| 2 dxdt'. 

Let us next look at the terms concerning Mctxip in 2(Pi, P2)l 2 (q)- First, wc 
have 

-M(osV,^)l»W) = (M/2) // a £F |V>| 2 d5?dI- (M/2) / a s (T, J)|V(0,J)| 2 dx. 

Then we find 

2M(a s ip,a^x)L 2 (Q) = -2M / / ajajslV'l 2 cEdf. 

The last term provides 

M 2 (a^ip,ip s ) L 2 (Q) = -(M 2 /2) // ass#| a dsd£ 

Finally, we deal with the computations of the term a^ip. First, we obtain 

(apP,^) L 2 {Q) = -(l/2) ff a^\ 2 dxdt +(1/2) f ai (T,x)\^(T,x)\ 2 dx. 
J Jq Jo 



Additionally, we find 

-(app,2a^x)^(Q) = jj (^t^xx + o-tx a x) \4 



b\ A dxdt. 
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Finally, 



■W.^)i'(fl) = ( M / 2 )// a al^l 



dx dt. 



Putting all these computations together, we conclude that the double product 
term is 
(2.633) 

2(P l ,P 2 ) L 2 (Q) = f \^(T,x)\ 2 dx 
Jo 

+ f ((2a s (t,l) + M)\^(ll)\ 2 -(2a^(t,0)+M)\^(t,0)\ 2 )dt 
Jo 

— 2 // axx\tpx\ 2 dx dt + 4 // axa~j\tp\ 2 dxdt — I a~(T,x)\ip(T : x)\ 2 dx 
JJq JJq Jo 

-6// a^al\tp\ 2 dx dt + 2M a~ 7 \ip\ 2 dx dt - M a 5 (T, x)\ip{T,x)\ 2 dx 

JJq JJq Jo 

— 6M // axO i xx\'>P\ dx dt — M // a^l'f/'l dxdt 

ct^j-| -0 1 2 dxdt + / otj{T, x)\ip(T, x)\ 2 dx + 2 // ajaxsl"^] 2 dxdt. 
iq Jo JJq 

On the other hand, we have the following for the right hand side term: 



(2.634) 



\ P 3\\l?(Q) 



a~7f\ili\ 2 dxdt. 



Combining (2.633) and ( 2.634 I with ( 2.632 I , we obtain 



(2a s (t,l) + M)\ijj s (t,l)\ 2 dt-2 // as3\1>s\ 2 d£<fi 



-6 / / a^xa^\ip\ dxdt + 2 // a^a^^l^l dxdt — QM j j UxOt-xx\i>\ dxdt 



-M" 



ot-xx\i)\ 2 dxdt 



i I ( xiw\'4 , \dxdt+ (2ax(t,0) + M)\iPx(t,0)r dt 



+4// a s a~ I \ip\ 2 dxdt-2M a~^\ 2 dxdt+ // a^Wdxdt 

Jq JJq " JJq 

al{T,x)\i>{T,x)\ 2 dx + M / a>z(T,x)\ip(T,x)\ 2 dx 

Jo 



oq(T,x)\il>{T,x)\ 2 dx. 



116 



2. LINEAR PARTIAL DIFFERENTIAL EQUATIONS 



' /''C 1 ) , ^.., /r,M2jr o /"/■ 0"(^,, ,2 



From the definition of a (given in (2.630)), we find 

M)\^(t,l)\ 2 dt-2 
t 

rr r"(t. 



q t 



\ipx\ dxdt 



^^- m ^ d t-2 if mmw&s 



t 3 



q (T-tr 



(2.635) 



-6M 



^ 



~ J- J \tp\ 2 dx dt - M 2 // ^H^| 2 dxdt 
Q (T - t) 2 J Jq t 

(P»(x)Y 



+4 



+2 



// 



(T-i) 2 
Q(T-i) 3 



|-0|^ d^cZt - 



|V»| 2 dxdt + 2M 



, ff'(0) 
't -t 
(3'(x) 



Q{T-t) 



M\\^(t,0)\ 2 dt 

\ijj\ 2 dxdt 



3 X l \<p\ 2 dxdt+i- [ {p'{x)) 2 \i;{T,x)\ 2 dx 
(T-t) 3 T 2 Jo 



+ ^L f p'{x)\^{T,x)\ 2 dx+l- f [3{x)\^{T,x)\ 2 dx. 
T Jo T 2 Jo 

Let us now define the function (3 : [0, 1] — > R. Let <5 G (0, 1). We take the function 
(3 satisfying 

1 2(f3'(x)) 2 + (3(x) 



(2.636) 



P"(x) 



£€[0,1], 



l-63{f3'{x)) 2 + [3{x) 

together with the initial conditions /3(0) = 5 and /3'(0) = 0.807. One can check, 
that, for S > small enough, 

(2.637) (3 > 0, /?' > and /?" < on [0, 1], 

(2.638) /3(1) < 0.435. 



We choose S > such that (|2.637| and (|2.638| hold. From (|2.635|, (|2.636|) and 



(2.6371, we have 
-2 



-\^\ 2 dxdt-2S I I p"(x) ^ x)+ ^'( x))2 M 2 dxdt 



-6M 



f3'(x)(3"(x). ,., ,_ ~ ~, /•/• /?"(£), , l2 ,_ ,~ 
— \i(;\ 2 dxdt-M 2 '—^-\ip\ 2 dx dt 



(2.639) 



I 2 



Q t 



^ 



+2M 



{f3 'l x))2 \i;\ 2 dxdt+ [ (2Q5) + M)|^(I,0)| 2 dt 
t 2 Jo t 



^M\^j\ 2 dxdt+^- I {(3'{x)) 2 \^{T } x)\ 2 dx 
t 2 



1 

T 2 j„ 



m r 1 



+ ^ I (3'{x)\^{T 1 x)\ 2 dx+^- f [3{x)\iP{T,x)\ 2 dx. 
T Jo T 2 Jo 

Additionally, using (2.6371 and the fact that j3"(x) ^ — 2/((l — 6)3), we get the 

existence of a universal constant mi > (in particular, independent of e, T, L, M , 

ip°) such that, if 



(2.640) 



M > rqrj 



2.7. SINGULAR. OPTIMAL CONTROL 



117 



then 

(2.641) - 3M 



t 2 



> 



\ip\ 2 dxdt 
((i"(x)f 



\ip\ 2 dxdt + 2M 



&&,.,.* 



I 2 



\il)\ 2 dxdt. 



From ( |2.637} , ( |2.639| and (|2.64l}, we have 

(3"{x 



(2.642) - M z 



/. 



2 dxdt^ f {2^M + M)|^(t,0)| 2 dt 
Jo t 



M 



i- / (P'(x)) 2 \^(T,x)\ 2 dx+ 1 -^ I P'(x)\iP(T,x)\ 2 dx 
T z Jo T Jo 



1 
T 2 Jo 



f](x)\tp{T,x)\ 2 dx. 



Let us reca ll that V := e~ a ip. Then, from ( |2.602[ ), ( |2.629| , ( |2.630| ), ( |2.637| , ( |2.640[ ) 
and (2.642), we deduce that 

(2.643) M [J le- 2a \fi\ 2 dxdt^C ( J \^{t,0)\ 2 dt+ L f \^(0,x)\ 2 dx\ . 



In (2.643 I and from here on, C will stand for generic positive constants independent 

of £, M, T, L and tp°. 

Let < 7 < 1/3 be fixed (one can take for example 7 := 1/6). By (2.630) 
and (2.637), e~ 2a reaches its minimum in the region [(1 — 37)T/3,T/3] x [0, 1] at 
(t,x) = (T/3,1). Hence 



M 



1 r T/3 



(2.644) -^e 



2o(T/3,l) / / \£\ 2 dtdx 

T Jo J(l-3-y)T/3 

f 



1 



( \ I \&{t,0)\ 2 dt+^ I \£{0,x)\ 2 d5 



From (2.6301, we deduce, using (2.565) and (2.6381, that 



(2.645) 



exp{-2a(T/3,l)} = exp{-6/3(l)/T} > exp{-A/T}. 



Coming back to our original variables (see (2.6241, (2.626) and (2.627)), we get 
from (12.644} and (|2.645|), 



(2.646) 



\(p\ dtdx 



nT/3 
,1-37)773 

< Ce AL2 /^ 



M 



p x (t,0)\ 2 dt- 



L 

17 



MT,x)\ 2 dx 



From now on, we assume that (2.609} holds. Let us apply the dissipativity result 
stated in Lemma 2.100 on page 111 



to ip° := ip(t,-), with t € [(1 - 37)T/3,T/3] 
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and T :=T-t. This is possible, since, by fl2.565| and fl2.567| , (2T/3) > 3(L/M). 
We obtain 

(2.647) f L f T/ ' \<p\*dtdx > ^_ e 3((2T/3)M-L)V(4eT) ^ |^ (T) x) |2 & . 

^0 J(l-3 7 )T/3 L,LM° J Q 



Note that the Poincare inequality, together with (2.6021, tells us that 

(2.648) / Lp(T,x) 2 dx^CL 2 ip x {T,x) 2 dx. 

Jo Jo 



Let us also point out that (2.5651 and (2.5671 imply that 

1 M 2 T 2 



3 (1TM 



31 



1 



A5j 



C L 2 



which combined with (2.567), (2.6461, (2.6471 and 



of Cfn > max{rfi[Tjl} such that (LM/e) ^ qrj and ( |2.567 
concludes the proof of Theorem |2.96| on page |105| 



2.6481, yields the existence 



imply (2.6041. This 



2.7.2.3. An open problem. Of course, as one can already see in [124], the con- 
stants 4.3 and 57.2 in Theorem |2.96| are not optimal. Our open problem in this 
section concern improvements of these constants. In particular, it is natural to ask 

Open Problem 2.102. Assume that 

M > 0, TM > L. 

Is it true that 

K(e, T, L, M) ->Q ase->Ql 
Assume that 

M < 0, T\M\ > 2L. 
Is it true that 

K(e, T, L, M) -> as e -> 0? 



2.8. Bibliographical complements 

In this chapter we have already given references to books and papers. But 
there are of course many other references which must also be mentioned. If one 
restricts to books or surveys we would like to add in particular (but this is a very 
incomplete list): 

- The book [47] by Alain Bensoussan on stochastic control. 

- The books [491 I50| by Alain Bensoussan, Giuseppe Da Prato, Michel 
Delfour and Sanjoy Mitter, which deal, in particular, with differential con- 
trol systems with delays and partial differential control systems with spe- 
cific emphasis on controllability, stabilizability and the Riccati equations. 



- The book [139 by Ruth Curtain and Hans Zwart which deals with general 
infinite-dimensional linear control systems theory. It includes the usual 
classical topics in linear control theory such as controllability, observabil- 
ity, stabilizability, and the linear-quadratic optimal problem. For a more 
advanced level on this general approach, one can look at the book [462] by 
Olof Staffans. 
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The book |140J by Rene Dager and Enrique Zuazua on partial differential 
equations on planar graphs modeling networked flexible mechanical struc- 
tures (with extensions to the heat, beam and Schrodinger equations on 
planar graphs). 

The book .154] by Abdelhaq El Ja'i and Anthony Pritchard on the input- 
output map and the importance of the location of the actuators/sensors 
for a better controllability/observability 

The books [16Ql 1161 j by Hector Fattorini on optimal control for infinite- 
dimensional control problems (linear or nonlinear, including partial differ- 
ential equations). 

The book [182 by Andrei Fursikov on study of optimal control problems 
for infinite-dimensional control systems with many examples coming from 
physical systems governed by partial differential equations (including the 
Navier-Stokes equations). 

The book 280J by Vilmos Komornik and Paola Loreti on harmonic (and 
nonharmonic) analysis methods with many applications to the controlla- 
bility of various time-reversible systems. 

The book [294J by John Lagnese and Giinter Leugering on optimal control 
on networked domains for elliptic and hyperbolic equations, with a special 
emphasis on domain decomposition methods. 

The books |301L I302J by Irena Lasiecka and Roberto Triggiani which deal 
with finite horizon quadratic regulator problems and related differential 
Riccati equations for general parabolic and hyperbolic equations with nu- 
merous important specific examples. 

The book [487 by Marius Tucsnak and George Weiss on passive and con- 
servative linear systems, with a detailed chapter on the controllability of 
these systems. 

The survey [5211 by Enrique Zuazua on recent results on the controllability 
of linear partial differential equations. It includes the study of the control- 
lability of wave equations, heat equations, in particular with low regularity 
coefficients, which is important to treat semi-linear equations (see Section 



4.3), fluid-structure interaction models. 

The survey [519j by Enrique Zuazua on numerical methods to get optimal 

controls for linear partial differential equations. 



Part 2 

Controllability of nonlinear control 

systems 



A major method to study the local controllability around an equilibrium is to 
look at the controllability of the linearized control system around this equilibrium. 
Indeed, using the inverse function theorem, the controllability of this linearized 
control system implies the local controllability of the nonlinear control system, 
in any cases in finite dimension (see Section 3.1 and in particular Theorem 3.8 on 



page 128 1 and in many cases in infinite dimension (see Section 4.1 for an application 
to a nonlinear Korteweg-de Vries equation) . In infinite dimension the situation can 
be more complicated due to some problems of "loss of derivatives" as explained 



in Section 4.2 However, suitable iterative schemes (in particular the Nash-Moser 



process) can allow to handle these cases; see Section 4.2.1 and Section 4.2.2 



When the linearized control system around the equilibrium is not controllable, 
the situation is more complicated. However, for finite-dimensional systems, one 
knows powerful tools to handle this situation. These tools rely on iterated Lie 
brackets. They lead to many sufficient or necessary conditions for local controlla- 
bility of a nonlinear control system. We recall some of these conditions in Section 
|3.2| Section |3.3| and in Section |3.4| 

In infinite dimension, iterated Lie brackets give some interesting results as we 
will see in Chapter [5] However, we will also see in the same chapter that these iter- 
ated Lie brackets do not work so well in many interesting cases. We present three 
methods to get in some cases controllability results for some control systems mod- 
eled by partial differential equations even if the linearized control system around 
the equilibrium is not controllable. These methods are: 

1. the return method (Chapter pi, 

2. quasi-static deformations (Chapter ul, 

3. power series expansion (Chapter M). 

Let us briefly describe them. 

Return method. The idea of the return method goes as follows. Let us 
assume that one can find a trajectory of the nonlinear control system such that: 

- it starts and ends at the equilibrium, 

- the linearized control system around this trajectory is controllable. 

Then, in general, the implicit function theorem implies that one can go from every 
state close to the equilibrium to every other state close to the equilibrium. In 
Chapter [6] we sketch some results in flow control which have been obtained by this 
method, namely 

1 . global controllability results for the Euler equations of incompressible fluids 
(Section 6.2.1 ), 

2. global controllability results for the Navier-Stokes equations of incompress- 
ible fluids (Section [6T2~2~2| , 

3. local controllability of a 1-D tank containing a fluid modeled by the shallow 
water equations (Section 6.3 1. 

Quasi-static deformations. The quasi-static deformation method allows one 
to prove in some cases that one can move from a given equilibrium to another given 
equilibrium if these two equilibria are connected in the set of equilibria. The idea is 
just to move very slowly the control (quasi-static deformation) so that at each time 
the state is close to the curve of equilibria connecting the two given equilibria. If 
some of these equilibria are unstable, one also uses suitable feedback laws in order 
to stabilize them: without these feedback laws the quasi-static deformation method 
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would not work in general. We present an application to a semilinear heat equation 



(Section 7.2) 



Power series expansion. In this method one makes some power series ex- 
pansion in order to decide whether the nonlinearity allows to move in the (oriented) 
directions which are not controllable for the linearized control system around the 
equilibrium. We present an application to the Korteweg-de Vries equation (Section 



8.21 



These three methods can be used together. We present an example for a Schro- 
dinger control system in Chapter [9] 



CHAPTER 3 



Controllability of nonlinear systems in finite 

dimension 

Throughout this chapter, we denote by (C) the nonlinear control system 

(C) x = f(x,u), 

where x G K n is the state, u G K m is the control, with (x,u) G O where O is a 
nonempty open subset of R n x R m . Unless otherwise specified, we assume that 
/ G C°°{0\ R"). Let us recall the definition of an equilibrium of the control system 
x = f(x,u). 

Definition 3.1. An equilibrium of the control system x = f(x,u) is a couple 
(x e ,u e ) G O such that 

(3.1) f(x e ,U e )=0. 

Let us now give the definition we use in this book for small-time local control- 
lability (we should in fact say small-time local controllability with controls close to 
u e ). 

Definition 3.2. Let (x e ,u e ) G O be an equilibrium of the control system 
x = f(x,u). The control system x = f(x,u) is small-time locally controllable at 
the equilibrium (x e ,u e ) if, for every real number e > 0, there exists a real number 
r\ > such that, for every x° G B v (x e ) := {x G R"; \x — x e \ < 77} and for every 
x 1 G B v (x e ), there exists a measurable function u : [0,e] — > M. m such that 

|«(t)-«e| <e, ViG [0,e], 

(x = f(x,u(t)),x(0) =x°) => (x(e) =x 1 ). 

One does not know any checkable necessary and sufficient condition for small- 
time local controllability for general control systems, even for analytic control sys- 
tems. However, one knows powerful necessary conditions and powerful sufficient 
conditions. In this chapter we recall some of these conditions. In particular, 

- If the linearized control system at (x e , u e ) is controllable, then the nonlinear 
control system x = f(x,u) is small-time locally controllable at (x e ,u e ); see 
Section 13. II 

- We recall the necessary Lie algebra rank condition. It relies on iterated Lie 
brackets. We explain why iterated Lie brackets are natural for the problem 



of controllability; see Section 3.2 



We study in detail the case of the driftless control affine systems, i.e, the 
case where f(x, u) = 2j=i u ifi( x )- For these systems the above Lie algebra 
rank condition turns out to be sufficient, even for global controllability; see 
Section 13.31 
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- Among the iterated Lie brackets, we describe some of them which are 
"good" to give the small-time local controllability and some of them which 
lead to obstructions to small-time local controllability; see Section |3.4| 

3.1. The linear test 

In this section we prove that if a linearized control system at an equilibrium 
(resp. along a trajectory) is controllable, then the nonlinear control system is 
locally controllable at this equilibrium (resp. along this trajectory). We present an 
application of this useful result. 

We assume that the map / is only of class C 1 on O. We study in this section: 

- the local controllability along a trajectory, 

- the local controllability at an equilibrium point. 

3.1.1. Local controllability along a trajectory. We start with the defini- 
tion of a trajectory. 

Definition 3.3. A trajectory of the control system x = f(x,u) is a function 
(x, u) : [To,Ti] — > O such that 

(3.2) T < Ti, 

(3.3) x G C°([To,Ti];R n ), u € L°°((T ,Ti);R m ), 

(3.4) 3 a compact set K C O such that (x(t), u(t)) € K 

for almost every t G (To,Ti), 

(3.5) x(t 2 ) = x(h) + [ 2 f(x(t),u(t))dt 7 V(t x> t 2 ) e [T , T x ]. 
Let us make some comments on this definition: 



- If u is also continuous on [Tq,Ti], then (3.4) is equivalent to 



(s(t),«(t))eO,Vte[T ,Ti]. 



Moreover, in this case, x is of class C 1 and (3.5 1 is equivalent to 



i(t) = f(x(t),u(t)),Vte[T ,T 1 



Taking into account (3.3) and (3.4), (3.5) is equivalent to 



(3.6) x = f{x,u)mV'(T a ,T 1 y 



In (3.6), T>' {Tq,T\) denotes the set of distributions on (To,Ti). Hence (3.6 1 just 
means that, for every ip : (To,Ti) — > MJ 1 of class C°° and with compact support, 

(x(t) ■ tp(t) + f(x{t),u(t)) ■ <p(t))dt = 0. 

For simplicity, when no confusion is possible, we write simply "x = f(x, u)" instead 
Of "J = /(x ! u)mP / (T ,T 1 )"". 

Let us now define the notion of "local controllability along a trajectory" . 

Definition 3.4. Let (x, u) : [T , T{\ -»Obea trajectory of the control system 
x = f(x,u). The control system x = f(x,u) is locally controllable along the trajec- 
tory (x,u) if, for every e > 0, there exists r] > such that, for every (a,b) € R n xl" 
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with \a— x(To)\ < rj and \b— x(T\)\ < ij, there exists a trajectory (x, u) : [To, T{\ — > O 
such that 

x(T Q ) = a, x(Ti) = b, 

|«(t)-«(*)| ^e,te [Tq,^]. 

Let us also introduce the definition of the linearized control system along a 
trajectory. 

Definition 3.5. The linearized control system along the trajectory (x,u) : 
[To, Ti] — > O is the linear time- varying control system 

df df 

±= ^(^Mt))^ + ^(x(t),u(t))u, t g [T ,T x l 

where, at time t G [T ,Ti], the state is x(t) G R™ and the control is u(t) G R m . 

With these definitions, one can state the following classical and useful theorem. 

Theorem 3.6. Let (x,u) : [To,Ti] — > O be a trajectory of the control system 
x = f(x,u). Let us assume that the linearized control system along the trajectory 
{x,u) is controllable (see Definition 1.2 on pageuM. Then the nonlinear control 



system x = f(x,u) is locally controllable along the trajectory (x,u). 
Proof of Theorem |3.6| Let T be the map 

K" x L°°((T ,Ti);K m ) -> I"xR" 

(a,u) h-> T(a,u):=(a,x(Ti)), 

where x : [To, T{\ — ► W 1 is the solution of the Cauchy problem 

x = f{x,u(t)), x(T ) = a. 

It is a well known result (see, e.g., [458, Theorem 1, page 57]) that this map T is well 
defined and of class C 1 on a neighborhood of (x(T ),u) in K™ x T°°((To, T x ); W n ). 
Its differential T 1 (x(Ta),u) is the following linear map: 

R™ x T°°((To,Ti);R m ) -> I"xR" 
(a,u) ^ (a,x(Ti)), 

where x : [T , T\] — > M. n is the solution of the Cauchy problem 

df df 

x = —{x(t),u{t))x+ —{x{t),u(t))u, x(T ) = a. 



It follows from the hypothesis of Theorem 3.6 (i.e., the controllability of the lin- 
earized control system along the trajectory (x,u)) that T'(x{T ),u) is onto. Since 
W l x W 1 is of dimension 2n, this gives the existence of a linear subspace E of 
dimension In such that 

(3.7) F'{x{T ),u)E = R" x R™. 

We apply the usual inverse function theorem to the restriction of T to E. We get 
the existence of a v > and of a map Q of class C 1 from -B„(:c(To)) x B v {x{T\)) 
into E, with B v {z) := {x G R"; \x — z\ < v] such that 

(3.8) g(x(T ),x(T x )) = (x(T ),u) eEcR n x ^((Tq,^)^'"), 

(3.9) F og(a,b) = (a,b),V(a,b) £ B u (x(T )) x B v {x{T x )). 

Let us write Q(a,b) = {G 1 {a,b),g 2 {a,b)) G R" x L°°((To,Ti);R m ). Let us take 

(a,b)eB l ,(x(T a ))xB l ,(x(T 1 )). 
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From (3.9), we get that Q\{a, b) = a and that, if x : [To, T{\ — > K™ is the solution of 
the Cauchy problem 

x = f(x, Q 2 (a, b){t)), x(T ) = a, 



then x{Ti) = b. Finally, since Q is of class C , it follows from (3.8 I that there exists 
C > such that, V(a, b) e B v (x(T Q )) x B^Ti)), 

||£ 2 (a,&) -uIIl^ccto,^)^™) ^ C\{a,b) - (x(T ),x(Ti))\ 

< C(\a-x(T Q )\ + 16-5(^)1). 

This concludes the proof of Theorem |3.6| ■ 



3.1.2. Local controllability at an equilibrium point. In this section the 
trajectory (x,u) is constant: there exists (x e ,u e ) G O such that 

(x(t),u(t)) = (x e ,u e ), t e [T ,Ti]. 

In particular, 

(3.10) f(x e ,u e )=0, 



i.e., (x e ,u e ) is an equilibrium of the control system x = f(x,u) (see Definition 3.1 
on page 



125 I. Following Definition 3.5 we introduce the following definition. 



Definition 3.7. Let (x e ,u e ) be an equilibrium of the control system x = 
f(x,u). The linearized control system at (x e ,u e ) of the control system x = f(x,u) 
is the linear control system 

df df 

(3.11) x = —(x e ,u e )x+ —(x e ,u e )u 

ox ou 

where, at time t, the state is x(t) € R™ and the control is u(t) G R™. 



Then, from Theorem |3.6| on the previous page, we get the following classi- 
cal theorem, which is a special case of a theorem due to Lawrence Markus [343 
Theorem 3] (see also |309| Theorem 1, page 366]). 

Theorem 3.8. Let (x e ,u e ) be an equilibrium point of the control system x = 
f(x,u). Let us assume that the linearized control system, of the control system x = 
f(x,u) at (x e ,u e ) is controllable. Then the nonlinear control system x = f(x,u) is 
small-time locally controllable at (x e ,u e ). 



Theorem |3.8[ which is easy and natural, is very useful. Let us recall that one 
can easily check whether the controllability of the linearized control system of the 
control system x = f(x,u) at (x e ,u e ) holds by using the Kalman rank condition 
(Theorem 1.16 on page^l). 



Let us give an application in the following example. 

Example 3.9. This example deals with the control of the attitude of a rigid 
spacecraft with control torques provided by thrust er jets. Let r\ = (cf>,9,Tp) be the 
Euler angles of a frame attached to the spacecraft representing rotations with respect 
to a fixed reference frame. Let lu = (a>i, ^2,^3) be the angular velocity of the frame 
attached to the spacecraft with respect to the reference frame, expressed in the frame 
attached to the spacecraft, and let J be the inertia matrix of the satellite. The 
evolution of the spacecraft is governed by the equations 

m 

(3.12) Juj = S(uj) Juj + y^Uibi, fj = A(r])uj : 
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12') 



where the Ui G K, 1 5j i ^ m, are the controls. The b\, . . . , b m are in fixed vectors 
in R 3 (uibi G R 3 , 1 ^ i Sj m are the torques applied to the spacecraft) , S{u>) is the 
matrix representation of the wedge-product, i.e., 





(3.13) 

and 

(3.14) 



S(w) 



A(rf) 



-uj 3 

U>2 



costf 
sin 9 tan <f> 



W3 






cos # tan ( 



sin J cos (j) cos #/ cos <ft 



and the control is 



The state of our control system is (r^, 772, J73, aj!, oj 2 , <^3)* r £ 
(ill, . • . , u m ) tr G R m . Concerning the problem of controllability of (3.14), without 
loss of generality, we assume that the vectors bi,...,b m are linearly independent 
and that 1 ^ m Sj 3. We consider the equilibrium (0,0) G R 6+m . The linearized 
control system at this equilibrium is 



i—m 

£ 

i=\ 



UiJ h 



(3.15) f\ = w, u> = 

where the state is (771, 772, n 3 , 101,102, u>^) tr G K 6 and the control is {u\, . . . , u m ) tr G 
W n . Using the Kalman rank condition (Theorem 1.16 on pageWy, one easily checks 
that the linear control system (3.15) is controllable if and only if m = 3. Hence, 
from Theorem \3.8\ on the previous page, we get that, if m = 3, the control system 
(3.12) is small-time locally controllable at the equilibrium (0,0) G K 6 x K 3 . Of 



course for m ^ 2, one cannot deduce anything about the nonlocal controllability of 



(3.12) from the nonlocal controllability of the linearized control system (3.15). We 



will study the small-time local controllability of (3.12) for m ^ 2 in Example 3.35 
on page \144\ 

3.2. Iterated Lie brackets and the Lie algebra rank condition 

Let us first recall the definition of the Lie bracket of two vector fields. 
Definition 3.10. Let ft be a nonempty open subset of 1". Let 

X := (X\...,X") tr G C^ftjR"), 

f:=(y 1 ,..,r) tr eC 1 (!];t''). 

Then the Lie bracket [X, Y] := {[X, Y] 1 , . . . , [X, y] n ) tr of X and Y is the element 
in C°(ft;R n ) defined by 

(3.16) [X, Y](x) := Y'{x)X{x) - X'{x)Y{x), Vx G ft. 

In other words, the components of [X, Y] (x) are 

dx j 



(3.17) [X,YY{x) = Y J X k { 



k=l 



dY\ 
x, « — w 

ox k 



For X G C°°(ft; 



Y G C°°(ft; 



Y«(x)^-(x),Vj£{l,...,n},Vx€n. 
), one has the Jacobi 



dx k 

') and Z G C°°(ft; 



identity 
(3.18) 



[X, [Y, Z\\ + [Y, [Z, X}} + [Z, [X, Y}} = 0. 
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Note also that, if X € C°°(R n ;K") and Y £ C°°(K n ;M") are denned by 

X(x) := Ax, Y(x) := Bx, Vx £ R n , 

where A £ A / f nj „(K) and B £ _A/!„ in (K) are given, then straightforward computa- 
tions show that 

(3.19) [X,Y]{x) = {BA-AB)x,Vx£R n . 

The following definition will also be useful. 

Definition 3.11. Let Q be a nonempty open subset of R n , X £ C°°(f2;R™) 
and Y £ C°°(0;K n ). One defines, by induction on k £ N, &d x Y £ C°°(f2;M") by 

ad^y = Y, 

ad^ +1 y = [X, ad x Y], Vfc £ N. 

Before giving the Lie algebra rank condition, let us first explain why it is quite 
natural that Lie brackets appear for controllability conditions: 

- for necessary conditions of controllability because of the Frobenius theorem 



(Theorem 3.25 on page 141 ) 



- for sufficient conditions because of the following observation. Let us assume 
that m = 2 and that f(x,u) = u 1 fi(x) + Uzfeix) with /i £ C°°(f2), 
ji £ C°°(Q), where fl is a nonempty open subset of R n . Let us start from 
a given initial state a £ fl. Then one knows how to move in the (oriented) 
directions ±/i(o) even with small control: just take U\ = r\ ^ and u-i = 0. 
Similarly, one knows how to move in the (oriented) directions ±/2(a). Let 
us explain how to move in the direction of the Lie bracket [/i, f%\ (a). 

Let 9 t : R x R n -* R, (t,x) -> *|(cc) be the flow associated to f { (for 
i £ {1,2}), that is 

(3-20) ^ = /<(*i), *?(*)=*• 

Let r\\ £ R and r\i £ R be given. Then straightforward computations show 
that 

fy' 1126 f^T 1116 (\HH 2£ (ty? 16 (a))))) - a 
(3-21) lim ( * 2 (Wl (W % (Wl W)))) a = mm[h,h\{a). 

Hence, if one starts at a, that is, if a;(0) = a, and if one takes 

(tti(t),« 2 (t)) = (»?i,0),f6rt€ (0,e), 
(«i(t),« 2 (<)) = (0 J »j2), forte (e,2e), 
(«i(t),« 2 (<)) = (-J71.0), for t £ (2e,3e), 
(«i(t),«2(<)) = (0, -rn), for t £ (3e,4e), 

then, as e — > 0, 

(3.22) x{Ae) = a + f]ime 2 [h, f 2 ](a) + o(e 2 ). 

Hence we have indeed succeeded to move in the (oriented) directions ±[/i, ^K )- 
Even in the case of a control system with a drift term, Lie brackets also appear 
naturally. The drift term is the vector field x t— > f(x,u e ). One says that one has a 
driftless control system if this vector field is identically equal to 0. Let us consider 
for example the case where m = 1 and 

(3.23) /(*,«) = /o(aO + u/i(aO, 



3.2. LIE ALGEBRA RANK CONDITION 131 

with 

(3.24) / (o) = 0. 

(Hence, if u e = 0, the drift is /g.) We start again at time at the state a. One 
can clearly move in the (oriented) directions ±/i(a). Let r\ G M. be fixed and let us 
consider, for s > 0, the control defined on [0,2e] by 

u(t) = -r] for t G (0,e), 
u(t) = r\ for t G (e,2e). 

Let x : [0,2e] -> R n be the solution of 

x = fo(x) + u(t)fx(x), x(0) = a. 

Then, straightforward computations show that, as e — > 0, 

(3.25) x(2e) = a + e 2 r)[f , fi](a) + o(e 2 ). 

Hence we have succeeded to move in the (oriented) directions ±[/ ,/i](a). Of 
course the case of a system with a drift term is more complicated than the case 
without drift. For example, in the previous driftless case, one can keep going and 
for example move in the direction of [[/i, f^, /i](a). However, in the case with the 
drift term, one cannot always move in the direction of [[/i,/o],/i](g). Indeed, let 
us consider, for example, the following control system: 

(3.26) X\ = x\, &2 = u, 

where the state is x = (xi, £2) tr G K 2 and the control is u G K. Hence 

/o(s) = (^ J 0) tr ,/ 1 (x) = (0,l) tr . 
One easily checks that 

[[/i,/o],/i](aO = -(2,0) tr . 



However, for a trajectory t — > (x(t),u(t)) of (3.26), t — * Xi(t) is a nondecreasing 



function. Hence one cannot move in the direction of [[/i, /o], /i](0) for the control 



system (3.26) 



But there are "iterated" Lie brackets which are indeed "good" for systems with 
a drift term. Let us give the simplest one. We start with a definition. 

Definition 3.12. The control system x = f(x,u) is said to be control affine if 
there are m + 1 maps /, ,i£ {0, . . . , m}, such that 

m 

f(x, U) := f {x) + ^ u ifi( x )i V ( x ' u ) e °- 
i=l 

Let us assume that the control system x = f(x,u) is control affine and that 
O = £1 x R m , where f2 is a nonempty open subset of R". Hence 

m 

x = f{x,u) := fo{x) + ^2uifi(x) 

■i=i 

with fi € C°°(n;R n ), i G {0,...,m}. Let a G O be such that 

/o(o) = 0. 



132 3. CONTROLLABILITY OF NONLINEAR. SYSTEMS IN FINITE DIMENSION 

We explain how to move in the (oriented) directions ±ad< /j(o), for every k G N and 
for every j G {1, . . . , m}. Let us fix j G {1, ... ,m} and fc € N. Let G C fe ([0, 1]) 
be such that 

(3.27) <t> (l \o) = 4> (l) (l) = 0, VI e {0, . . . , fc - 1}. 

Let?7 G (0,1] and let e G [0,1]. Let us define u : [0,7/] -+ R m , £ i-> («i(t), . . . , w m (i)) tr 
by 

(3.28) u i (t) = 0if«^j,V*G[0 > » ? ] > 

(3.29) Uj (t) = e<j) (k \t/r)), Vt G [0,r/]. 
Let a; : [0, 77] — > K™ be the solution of the Cauchy problem 

771 

x = fo(x) + ^ Ui(t)fi(x), x(0) = a. 

Let us check that 

(3.30) x(rj) = a + er/ fe+1 f j 0( r )dr) ad^/^a) + 0(e 2 + V k+2 ) as |s| + |t/| -> 0. 



Let A G 



n -M n ) and B G£(R m ;K™ 



be defined by 



Ux (a), B := ^(a,0) = (ji(a), . . . ,/ m (o)). 



Let 7/ : [0, 77] — > K™ be the solution of the Cauchy problem 

y = Ay + Bu(t),y (0)=0. 

Using Gronwall's lemma and the change of time r := t/rj, one easily checks that 
there exist C > and £0 > such that, for every e G [0, eo] and for every r\ G (0, 1], 

(3.31) \x(t) - (a + y(t))\ ^ Ce 2 , V* G [0, 77]. 



Let us estimate y(rj). One has, using (3.271, (3.28), (3.29), integrations by parts 
and the change of variable r := t/rj, 



y(v) 



^(t/v)e^^ A fi(a)dt 



Jo 



(-l)Ve / ^(t/^-^A^^dt 
Jo 

(-l)V +1 e / <l>(T)e r ><> 1 - r '> A A k f j (a)dT 



Hence, for some C > independent of e G [0, +00) and of rj G (0, 1], 



yfa)-(-l)V + '--( / <j>(r)dT)A"f j (a) 



(3.32) 

But, as one easily checks, 

(3.33) ad* o /» = (-l) fc A fc /i(a). 



<Cer/ 



fc+2 
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l.",:S 



Equality ( 3.30 1 follows from (3.311, (3.321 and (3.33). Note that by taking r\ 
£ i/(2fe+a) i n (|3.30|, one gets 



as e 



0, 



(3.34) x{rj) = a + s 3 ' 2 ( C 0(r)dr) &d k f Jj(a) + ( £ (3/2)+(i/(2fc+2)) ) 

which shows that one can move in the (oriented) directions ±&dtfj(a). From this 
fact one gets the small-time local controllability at the equilibrium (a, 0) of the 
control system x = f (x) + YT=i «*(*)/* 0*0 if 

(3.35) Spanjad^/^a); k e N, j e {1, . . . ,ro}} = K". 

This can be done, for example, by using the Brouwer fixed-point theorem, as does 



Halina Frankowska in [1761 1177] (see also Section 3.5.2 I or a constructive iterative 
scheme as Matthias Kawski does in [270j . 



Note that (3.351 is equivalent to the fact that the linearized control system of 
x = f(x,u) = fo(x) +^2 i= iUifi(x) around the equilibrium point (x e ,u e ) = (a, 0) 
is controllable. This indeed follows from (3.331 and the Kalman rank condition 
(Theorem 1.16 on page^l). (Note that the equality 



Span{ad /o /j(a); k € N, j £ {1, . . . , m}} 

= Span{adJ o j»; fc G {0, 



l},je{l,...,m}} 



follows from the Cayley-Hamilton theorem (see (1.41|) and (3.33 1). Hence, with 
these iterated Lie brackets ad^ fj{a), we just recover the linear test, i.e., Theo- 
rem |3.8| on page |128| 

Let us now give a necessary condition for local controllability. We start with 
some new definitions. 

Definition 3.13. Let Q, be a nonempty open subset of K n and let T be a family 
of vector fields of class C°° in £1. We denote by Lie(^-") the Lie algebra generated by 
the vector fields in T, i.e., the smallest linear subspace E of C°°(fi;R™) satisfying 
the following two conditions: 



(3.36) 
(3.37) 



T C E, 

(leBandFeB)^ ([X, Y] € E). 



(Such a smallest subspace exists: just note that E := C°°(il; R n ) satisfies (3.36) and 
(3.371 and take the intersection of all the linear subspaces of C°°(f2;K") satisfying 



( |3.36 | and (|3_37|).) 

For the next definition, let f2 be the open subset of 1 
n-.= {xeR n ; {x,u e )eO}. 
For every a G N m , 



defined by 



d\<*\f 
du a 



(■,u e )eC°°(n;R n ). 



Definition 3.14 ([106]). The strong jet accessibility subspace of the control 
system x = f(x,u) at an equilibrium point (x e ,u e ) is the linear subspace of R™, 
denoted by A (x e , u e ), defined by 



(3.38) 



J\ \x ei u e 



!*■>;): ue Li. .(^/(.,« e ), aen m } 
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Example 3.15. Let us assume that, for some open neighborhood lu of x e in K", 
there exist r > 0, and f Q , / 1; . . ., f m in C°°(uj; W 1 ) such that, for every x £ to and 
for every u = (ui, . . . , u m ) tr € W" 1 such that \u — u e \ < r, 

(x,u) e £>, 

m 

f(x,u) = fa{x) + ^2 l u i fi{x). 

Then 

A{x e ,u e ) = {g{x e );g e Lie({f , /i, . . . , f m })} . 

Let us now define the Lie algebra rank condition. 

Definition 3.16. The control system x = f(x,u) satisfies the Lie algebra rank 
condition at an equilibrium (x e ,u e ) if 

(3.39) A{x e ,u e )=R n . 

With these definitions, one has the following well-known necessary condition for 
small-time local controllability of analytic control systems due to Robert Hermann 
[221] and Tadashi Nagano [372 1 (see also [46.5] by Hector Sussmann). 

Theorem 3.17. Assume that the control system x = f(x,u) is small-time 
locally controllable at the equilibrium point (x e ,u e ) and that f is analytic. Then the 
control system x = f(x,u) satisfies the Lie algebra rank condition at (x e ,u e ). 

Note that the assumption on analyticity cannot be removed. Indeed, consider 
the following case 

n = m = l,0 = lxl, (x e , u e ) = (0, 0) e K x E, 
f(x, u) = uer 1/u2 if u j= 0, f(x, 0) = 0. 

Then -A(0, 0) = 0. However, the control system x = f(x, u) is small-time control- 
lable at the equilibrium point (x e ,u e ). 

The necessary condition for small-time controllability given in Theorem |3.17| 
is sufficient for important control systems such as, for example, the linear control 



systems x = Ax + Bu. This follows from the Kalman rank condition (Theorem 1.16 
on pagepM and the fact that 

A(x e , u e ) = Span {A^u; i e {0, . . . , n - 1}, u e K m } 



(see (3.33)). It is also a sufficient condition for driftless control affine systems, 
that is, in the case x = J^i=i u ifi{ x )\ this is the classical Rashevski-Chow theorem 
[398, 94 that we recall and prove in the following section. 

3.3. Controllability of driftless control affine systems 

In fact, for driftless control affine systems one also has a global controllability 
result as shown by the following theorem proved independently by Petr Rashevski 
in |398j and by Wei-Liang Chow in [94 1. 

Theorem 3.18. Let CI be a connected nonempty open subset of M. n . Let us 
assume that O = tt x K m and that for some fi,...,f m G C°°(fi;]R™), 

n i 

f(x,u) =53 «</<(»), V(a:,«) € fi x R"\ 
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l:jr. 



Let us also assume that 

(3.40) A{x, 0) = R", Vx G ft. 

Then, for every (x ,^ 1 ) € £1 x ft and for every T > 0, £/iere exists u belonging to 
L°°((0, T); K m ) suc/i i/iaf i/ie solution of the Cauchy problem 

x = f{x,u{t)),x(0) = x°, 

is defined on [0, T] and satisfies x(T) = x . 



Theorem |3.18| is a global controllability result. In general such a controllability 
result does not imply small-time local controllability. However, the proof of Theo- 
rem p38] given below also gives the small-time local controllability. More precisely, 
one also has the following theorem. 

Theorem 3.19. Let us assume that ft is a nonempty open subset ofW 1 , that 
ft x {0} C O and that, for some fi,...,f m € C°°(ft;]R n ) 7 



f(x,u) 



E 



Uifi(x), V(x,u) G O. 



Let x e G ft be such that 

A(x e ,0)=R n . 

Then the control system x = f(x, u) is small-time locally controllable at (£ e ,0) G O. 

Example 3.20. Let us consider the following control system (usually called the 
nonholonomic integrator) 

(3.41) Xl = Ml, ±2 = «2, x 3 = X\U 2 - X 2 Ui. 

Thus n = 3, m = 2, ft = K 3 and, for every x = (xi, x 2 , x^) tr G K 3 , 

(3.42) h{x) := , / 2 (x) := 
One easily checks that, for every x = {xi,X2-,Xz) tr 

(3.43) [fi,f2](x) = 




From \34ty and {3.^ , 

Span {fi{x), f 2 {x),[fi, f 2 ]{x)} 



,VxG 



Hence the control system (3.41) satisfies the Lie algebra rank condition (3.40) at 
every point x G R 3 . Therefore, by Theorem 3.18, this control system is globally 



controllable and, by Theorem \3. 19\ it is small-time locally controllable at every 
equilibrium (x e ,u e ) = (x e ,0) G K 3 x K 2 . 



Proof of Theorem |3.18| Let us give a proof of this theorem which does not 
require any knowledge of submanifolds or geometry. Just in order to simplify the 
notations, we assume that the vector fields /i, . . ., f m are complete, which means 
that the associated flow maps (t,x) i— ► ^\{x) (see (3.20)) are defined on the whole 
K x ft. In fact, this can always be assumed by replacing if necessary fi(x) by 



l.'il, 
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fi(x) = p{x){l + IMx)] 2 )- 1 /^) where p G C°°(fi, (0, 1]) is such that, if O ^ 
there exists C > such that 



(3.44) 



p(x) < Cdist{x,R n \ n), Vx e n. 



(The existence of such a p can be easily proved by means of a partition of unity 
argument; see, for example, [464, Theorem 2, Chapter 6, page 171] for a much 
more precise existence result.) Indeed: 

- The vector fields fi are complete. 

- The condition (3.401 implies the same condition for the function f(x,u) := 

for f(x,u) := J2T u ifi{ x ) implies the 



The conclusion of Theorem 
conclusion of Theorem 3.18 



3.18 
for f(x,u) :=YJ?uJ % (x). 



Let us first point out that, for every t < 0, 

(3.45) (y = -My), y(0) = x) =* (9\(x) = y(\t\)). 

Let 21(a) C SI be the set consisting of the **£ o Vl^*~* o . . . o $*• (a) where 

(3.46) fcGN\{0}, 

(3.47) i,e{l,...,m}, Vje{l,...,fc}, 

(3.48) tj G R, Vj G {1, . . . , A;}. 
Let us point out that it suffices to prove that 

(3.49) 21(a) = n, Va G ft. 



Indeed, let k, (*j)jg{i,...,fe} an d (^')j'e{i,...,fe} be such that (3.461, (3.47) and (3.48) 
hold. Let a G ft and let 



tfc-i 



(3.50) 6 := $? o * 

Let tq = and, for j G {1, . . . , k}, let 



.o*£(o)€n. 



Let u G L°°((0,T fc );K m ) be defined by 

u(t) = ejBij, Vi G (tj-i,tj), Vj G {1, . . . ,k}, 

where (ei, . . . , e m ) is the canonical basis of R m and Ej := Sign(ij), j G {1, . . . , k}. 
Let x G C°([0, Tfe]; fi) be the solution of the Cauchy problem 

x = f(x,u(t)), x(0) = a. 



Clearly (see also (3.45 l), 

£(t)=*£ t (a) > Vt€[0,Ti]. 

Similarly, by induction on j, one easily checks that 

(3.51) x(t) = ^ (t " Tj - l) o **>-\ 0...0 ^(a), V< G (ri-x.T,), Vj G {2,. . . , fc}. 
From (3.501 and (3.511, one has 

x(r k ) = b. 
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Let T > and let (x,u) G C°([0,T];O) x L°°((0, T); R m ) be defined by 

Tk _ ( r k € 



x(t) = x(^),Vte\0,T],u(t) 



T -u\ — j,We(0,T). 



Then (x,w) is a trajectory of the control system x = f(x,u) such that x(0) = a 



and £(T) = b. Hence property (3.491 implies Theorem 3.18 



Let us now prove that property (3.49) holds. From the definition of 21(d) for 
d G Cl, one easily gets that 

(3.52) (6 G 21(a) and c G 21(6)) => (c G 21(a)), V(a, 6,c) € ft x Cl x ft. 

Moreover, since 

*fo^r i (x) = x, Vi€fl, VieR, Vie {l,...,m}, 
one has 

b=^ k o**"- 1 o...o^(a) ^a=*7 tl o.^o^r'"- 1 o^7**>(6) 



and therefore 
(3.53) 



(6 € 21(a) =>■ a G 2t(6)), V(a,6)Gftxft. 



Since a € 21(a), it follows from (3.52) and (3.531 that the relation 

(3.54) b is related to a if and only if b G 21(a) 

defines an equivalence relation on ft. Since ft is connected, we get that, for every 
a G ft, 21(a) = ft if one has 



(3.55) 



21(a) is an open subset of ft, Va G ft. 



(Note that ft is the disjoint union of the equivalence classes of the relation (3.54) 



and that the equivalent class of a is 21(a).) Let us assume, for the moment, that 
the following lemma holds. 



Lemma 3.21. Under assumption (3.40) of Theorem 3.18 



21(a) has a nonempty interior, Va G ft. 



We assume (3.40). Let us prove (3.55) within the following two steps 



Step 1. Let us prove that 
(3.56) 21(a) is a neighborhood of a, Va G CI. 



From Lemma 3.21 there exists 6 G 21(a) such that 21(a) is a neighborhood of 
Since 6 G 21(a), there exist k G N\ {0}, k indices i±, 



,ik in {1, . . . , m} and k real 



, tk such that b = ip(a) with ip 



*t-i 






o v]/ 1 . Since ip is 



■ *i 



numbers t\ 

continuous, ^ _1 (2l(a)) is a neighborhood of a. Moreover, tp is a homeomor phism 

' *fc-i **; 






This expression of if) 1 and (3.52) 



of CI: one has ^ 

show that ?/> _1 (2l(a)) C 21(a), which concludes the proof of (3.561 



Step 2. 21(a) is an open subset of Cl. Indeed, let b G 21(a). Then 21(6) is a 



neighborhood of b. However, from (3.52), 21(6) C 21(a). Hence, by (3.56) applied to 
6, 21(a) is a neighborhood of 6. 

It only remains to prove Lemma |3.21| A key tool for its proof is the following 
classical lemma. 
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Lemma 3.22. Let k be in {1, . . . , n — 1}. Let ip : R — » O, y \— > ip(y) be a map 
of class C°° in a neighborhood of y e R k . Assume that (f'(y) is one-to-one. Then 
there exist an open subset lo of R k containing y, an open subset U of Q. containing 
<p{ui) and a map V G C°°{U;R n - k ) such that 

V(<p(y))=0,Vyeu>, 

kerV'(ip(y)) = tp'(y)(R k ),Vy e lu. 



Proof of Lemma 3.22 Let £ be a linear map from R n k to R n such that 
(3.57) £{R n - k ) + ip'{y){R k ) = R n . 

Let 

V> : R k x R"- k -> R", (y, z) h* ^(y, z) = <p(y) + t(z). 



From (3.57 1, ijj'(y,0) ls onto and therefore invertible. By the inverse function theo- 
rem, there exist an open subset U\ of R k x R n_fe containing (y, 0), an open subset 
U of R n containing tp(y) (= ip(y, 0)) and T G C°°(U; U x ) such that 

(■0(2/; z) = x and (y, z) G £/i) =>■ (x G f/ and (y, z) = T(x)). 

Let P 2 :R k x R n ~ k —> R n ~ k , (y, z) t-> z. One easily sees that it suffices to take 

(i) for to, an open subset of R k containing y and such that u> x {0} C U\, 
(ii) V = P 2 oT. 



This concludes the proof of Lemma |3.22| 



Let us now prove Lemma 3.21 Let a G f2. Let us first point out that the 
vectors /i(a), . . . ,/ m (a) cannot all be equal to 0. Indeed, if all these vectors are 
equal to 0, then A(a, 0) = (note that, if g G C°°(fi; R") and h G C°°(f2; R n ) are 



such that g(a) = and h(a) = 0, then [g,h](a) = 0), in contradiction with (3.401 
Let ii G {1, . . . , m} be such that 

(3.58) /n(a)/0. 

Let tp : R -* R n be defined by <p(t) := *^(o). We have p'(0) = / u (a). Hence, by 



(|3.58h, 95' (0) 7^ 0. If n= 1, {^(a);* G R} is a neighborhood of a. Hence we may 
assume that n ^ 2. We apply Lemma |3.22| with k = 1, and y = 0. We get the 
existence of e\ > 0, of an open subset $7i of $7 containing {^P* (a) ; £ G (— £i,£i)} 
and of V G C°°(n; R™" 1 ) such that 

(3.59) V^ t li (a)) = 0,yte(-e lj e 1 ), 

(3.60) ker V'(^ ti (a)) = R fa (*£ (a)), Vt G (-£1, £1). 
Then there exist i} G (— £i,£i) and i 2 G {1, ... , rn} such that 

V'(< ; (a))/ l2 (< ; (a))^0. 

Indeed, if this is not the case, then 

E:={ge C°°(ft;R") ; ^'(^(a))^*^)) = 0, Vi G (-£i,£i)} 

is a vector subspace of C°°(f2;R™) which contains the set {fi, ■ ■ ■ , f m }- Let us 
assume, for the moment, that 

(3.61) {ge E and he E)=> {[g,h}e E). 
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*-*'» 




/<.(*£(«)) 



Figure 1. /^(^(a)), /m^/w) are linearly independent 



Then 

and therefore 

in contradiction with ( 



Lie(/i,...,/ m ) C E 
A(a,0) cKer V'(a), 



Let us check (3.61 



3.40) for x = a and (3.60) for t = 



This is a consequence of the following lemma. 
Lemma 3.23. Let 6 e C^tyM 71-1 ) be such that 

(3.62) *(**») = 0,Vte(-ei,ei) 
and F e C"°°(fi;K n ) be such that 

(3.63) V'^i (a)) 2^ (a)) = 0, V* e (-£i, £i). 
Then 

(3.64) 0'(^ (a)) !?(*«») = 0, Vi € (-ei.ei). 

Indeed, it suffices to apply this lemma to (6, F) := (0, F) := (VV^ ■ 5, h) and to 
(0, F) := (6,F) := (W ■ /i, 5) and to check that 

(3.65) V6-F -\76-F = \7V-[g,h}. 

Let us now prove Lemma 3.23 Differentiating (3.621 with respect to t we get 



(3.66) 



'(** il (o))/ 4l (*J 1 (o)) = 0,Vte(-ei,e 1 ). 



But (3.601 and (3.631 imply that ^(^(a) ) = A (t)/ il ( g^ (a )), with X(t) € K for 
£ G (— £i,£i). This implies, together with (3.661, that ( 3.64 1 holds. Thus Lemma 
|3.23| is proved. 
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Therefore, there exist t\ G (— £i,£i) and 12 € {1, ■ ■ • 
(3-67) ^'(*j|(o)) / fa (*Jj WJ^O, 



i} such that 



which, together with (3.601, implies that 



t t 

(3.68) /j 1 (^' i 1 (a)) and / 2 ( v I' i 1 (a)) are linearly independent 

(see figure [I]). 

Let ip :R 2 -> R", (ti,t 2 



*- 2 o^JVa). One has 



C 21(a) and 



dip 

dip 



(*i,0) 
(*i,0) 



/fe (*£(«*)), 

/n(< ; (a))- 



In particular, with (3.68 I, </?'(£}, 0) is one-to-one. If n = 2, ^'(ij, 0) is then invertible 
and the inverse function theorem gives us that <p(R 2 ) (and therefore 21(a)) is a 
neighborhood of ip(t\ 7 0). Hence we may assume that n Jj 3 and one proceeds as 
above. For convenience let us briefly sketch how it is done. We apply Lemma |3.22| 



on page 
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1 with k = 2, y = (t\ , 0) . One gets the existence of an open subset uj of R 2 
containing y, an open subset U of f2 containing y>(u;) and a map V G C°°(U; R n_2 ) 



such that 



(3.69) 



V(p(ti,ta)) = > V(<i > <2)ea;, 
kerV'Mti.ta)) = /(<i,* 2 )(R 2 ), V(*i,*a) G w- 



Once more, one points out that there exist (t 2 ,i 2 ) € w and 23 € {1, . 



1} such 



that 

(3.70) V\ip{t\,tl))fMtl,tl))=£Q. 

Indeed, if this is not the case, then 

E := {/ e C°°(ft;R n ); V(¥>(y))/(p(y)) = 0, Vz 7 € w} 
is a vector subspace of C°°(f2; R") which contains the set {/1, . . . , f m }. As above, 



which contains the set {/1, 
J m )cE. 



one checks that (3.611 holds and therefore 

Lie (A 

Hence 

A(<p(y),0)cKerV'(<p(y)) 



which leads to a contradiction with (3.40). Let 

j> : R 3 -» O, (ti.fe.ta) -» *£ o ^ o**J(o). 
Then V(R 3 ) C 21(a). From ( |3.69| and ( |3.70| , we get that 

^(i 2 ,i 2 ,0)(R 3 )=R/, 3 Mi 2 ,i 2 ))©kerI/'(^(t 2 ,t 2 )). 

Therefore i//(*i: *2j 0) i s one-to-one (note that kery'(a;) is of dimension at least 
2 for every x € ip(u))). If n = 3, ^'(tf, t|, 0) is then invertible and the inverse 
function theorem gives us that ^(R 3 ), and therefore also 21(a), is a neighborhood of 
V>(£ 2 , £2, 0). If n > 3, one keeps going (one can easily proceed by induction). This 
concludes the proof of Theorem |3.18| ■ 
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Remark 3.24. Hector Sussmann and Wensheng Liu have given in |472j an 
explicit method to produce trajectories joining two given points for driftless control 
affine systems satisfying the Lie algebra rank condition at every (x,0). 

Let us end this section by recalling the Frobenius theorem. 

Theorem 3.25. Let us assume again that /i, . . . , f m G C°°(Cl; R n ). Let us also 
assume that there exists an integer k G {0, . . . , n} such that, at every point x G CI, 

the dimension of A(x,0) is k, Va; G CI. 

Then, for every a G CI, 21(a) is a submanifold of CI of dimension k. 

For a proof of this version of the Frobenius theorem, see, e.g., [258, Theorem 
4] (for a more classical local version, see, e.g., [496 Theorem 2.20, page 48]). 
Since a trajectory of the control system 

n l 

x = f(x,u) := fo(x) +^2uifi(x), 

i=\ 

where the state is x G CI and the control is {u\, . . . , u m ) tr G E m , is a trajectory of 
the control system 

m 

x = u fo{x) + ^2u l f l (x), 

i=l 

where the state is x G CI and the control is (mq, Ui, . . . , u m ) tT G E m+1 , we get as a 



corollary of the Frobenius Theorem 3.25 



Corollary 3.26. Let us assume again that /o, /l, • • -,/m G C°°(Cl;M. n ). Let 
us also assume that there exists an integer k G {1, . . . , n} such that, at every point 
x eCl, 

Span{h(x); h G Lie{fo, f%, . . . , f m }} is of dimension k. 

Then, for every x° G CI, the set of x 1 which can be reached from x° (i.e., the set of 
x 1 G CI such that, for some T > and some u G L°°((0,T);E m ) ; the solution of 
the Cauchy problem x = f(x,u(t)), x(0) = x°, satisfies x(T) = x 1 ) is contained in 
a submanifold of CI of dimension k. 

3.4. Bad and good iterated Lie brackets 

The necessary condition for controllability in the analytic case given in Theo- 
rem [3TT7] on page [T34] is not sufficient in general, as the two following simple control 
systems show 

(3.71) 

(3.72) 1 



n 


= 


1- 


m 


= 


1. 


O- 


= Ix 


E, 


x = 


u\ 


2, 


m 




1, 


O 




m. 2 


x K, 


Xl 


= x 2 


Xl 



(System (3.721 has already been studied on page 131 ) The control system (3.71) 
(resp. (3.72)) satisfies the Lie algebra rank condition at (0,0) G M x M (resp. 
(0,0) G rxl). However, this control system is not small-time locally controllable 
at (0,0) G E x E (resp. (0,0) G E 2 x E). Indeed, whatever the trajec tory (x, u) : 
[0, T] -> E x E (resp. (x,u) : [0,T] -> E 2 x E) of the control system (|3.7l|) (resp. 



(3.72 1) is, one has x(0) ^ x(T) (resp. a^i(O) < X\(T) with {x\,X2) = x tr ). 
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Let us now give sufficient conditions for small-time local controllability. To 
slightly simplify the notations, we assume that 

(3.73) x e = 0, u e = 0. 

(In any case, this assumption is not restrictive; just make a translation on the state 
and on the control.) We simply say "small-time locally controllable" instead of 
"small-time locally controllable at (0,0)". Our assumption (3.10) is now 

(3.74) /(0,0) = 0. 

Let us start with the case of a control affine system, i.e., 

m 

= Qx R"\ f(x, u) = /o(x) + J2 ««/<(*)> 

(=i 

where f2 is an open subset of K™ containing and the /i's are in C°°(f2;]R n ). 
In this case (3.74) is equivalent to /o(0) = 0. Let L(/o,...,/ m ) be the free Lie 
algebra generated by / , . . . , f m and let us denote by Br(/) C L(f , . . . , f m ) the 
set of formal iterated Lie brackets of {/o, /i, • • • , fm}', see [469] for more details and 
precise definitions. For example, 

(3.75) &:=[[[/o,[/i,/o]],/i],/o]e Br(/), 

(3.76) ft:=[[[[/o,[/i./o]],/i],/o],[/i,[/a,/i]]]G Br(/). 

For h € L(f , ..., f m ), let h(0) G R™ be the "evaluation" of h at 0. For h in Br(/) 
and i G {0, . . . , m}, let 5i(h) be the number of times that f\ appears in h. For 
example, 

1. with h given by (3.751, 8o(h) = 3, 6i(h) = 2 and 6i(h) = 0, for every 
ie{2,...,m}, 

2. with h given by |3?76| ), S (h) = 3, 6i(h) = 4, 6 2 (h) = 1 and 6i{h) = 0, for 
every i G {3, . . . , m}. 

Exercise 3.27. Let 



I, 



£ := Span I h(0); h £ Br{f) with J^ 5,(h) = 1 

I 8=1 



(3.77) 

Prove the following equalities: 

(3.78) £= Span{ad k f Ji(0); i G {l,...,m}, keN}, 

(3.79) £= Span{ad k fo fi(0);i€{l,...,m}, k e {0,1,. . . ,n- 1}}. 

(Hint for j[3.78\ ). Use the Jacobi identity fiS.ltfy .) 

Let & m be the group of permutations of {l,...,m}. For tt in & m , let tt 
be the automorphism of L(f , . . . , f m ) which sends /o to /q and /, to f n u) for 
i G {1, . . . , m}. For /i G Br(/), we let 



a(h):= Y^ x(h)eL(f ,...,f m ). 



nee,. 



For example, if h is given by (3.75 1 and rn = 2, one has 

^) = [[[/o,[/l,/o]],/l],/o] + [[[/o,[/2,/o]],/2],/o] 

Let us introduce a definition. 
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Definition 3.28 ( [469| Section 7]). For 8 G [0, +oo], the control system x = 
fo(x) + 5Z i=1 Wj/j(x) satisfies the Sussmann condition S(8) if it satisfies the Lie 



algebra rank condition (3.39) at (0,0) and if, for every h G Br(/) with 8q(K) odd 
and 5i(h) even for every i in {1, . . . ,m}, o~ (h)(0) is in the span of the g(0)'s where 
the g's are in Br(/) and satisfy 

m m 

(3.80) es (g) + J2 W < 0S oW + J2 W 

i=l i=\ 



with the convention that, when 8 = +oo, (3.80) is replaced by S (g) < S (h) 



Hector Sussmann has proved in [469 1 the following theorem. 

Theorem 3.29. |469l Theorem 7.3] //, for some 8 in [0, 1], the control system 
x = fo(x) + 2j=i u ifi( x ) satisfies the condition S(8), then it is small-time locally 
controllable. 

The following result is easy to check. 

Proposition 3.30. Let 8 be in [0,1]. Then the control system x = fo(x) + 
Si=i u ifi( x ) satisfies the condition S(8) if and only if the control system 

m 

x = fo(x) + ^ yifi(x), y — u, 

4 = 1 

where the state is (x, y) G M n xK m and the control is u G SJ 71 , satisfies the condition 
S (8/(1 — 8)) (with the convention 1/0 = +ooj. 

This proposition allows us to extend the condition S(8) to x = f(x, u) in the 
following way. 

Definition 3.31. Let 8 e [0,1]. The control system x = f(x,u) satisfies the 
condition S(8) if the control system x = f(x, y) 7 y = u satisfies S (8/(1 — 8)). 

What is called the Hermes condition is S'(O), a condition which was conjectured 
to be sufficient for small-time local controllability by Henry Hermes, who has proved 
his conjecture in the plane in |225j and has got partial results for more general 
systems in [228 . Hector Sussmann has treated the case of scalar- input (i.e., m = 1) 
control affine systems in [468 . 

It follows from |469j that we have: 

Theorem 3.32. //, for some 8 in [0,1], the control system x = f(x,u) satisfies 
the condition S(8), then it is small-time locally controllable. 



Proof of Theorem 3.32 Apply |469j to x = f(x,y), y = u with the con- 



straint L \u(s)\ ds sJ r (instead of \u\ Sj 1). 



One can find other sufficient conditions for small-time local controllability in 
[5] by Andrei Agrachev, in [6l [7] by Andrei Agrachev and Revaz Gamkrelidze, in 
|55j by Rosa Maria Bianchini, in [56 by Rosa Maria Bianchini and Gianna Stefani, 
in [270_ by Matthias Kawski, in [482] by Alexander Tret'yak, and in references of 
these papers. 



Ill 
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Example 3.33. If f(x,u) = Yl™=x u ifi{x) or if f(x,u) = Ax + Bu (i.e., for 
driftless control affine systems and linear control systems), the control system x = 
f(x,u) satisfies the Hermes condition if and only if it satisfies the Lie algebra rank 



condition at (0,0). Hence, by Sussmann's Theorem 3.29 on the preceding page, one 



recovers the Rashevski-Chow theorem, i.e., that for driftless control affine systems, 
small-time local controllability is implied by the Lie algebra rank condition at (0, 0) 



(Theorem 3.19 on page 135) and that the Kalman rank condition 



Span {A l Bu; ie[0,n-l],«6 K m } 



implies the controllability of the linear control system x = Ax + Bu (Theorem 1.16 
on pageUN. 



Example 3.34. We take n = 2, m = 1 and 

X\ = x\, Xi = u. 
In other words, our system is 

x= fo(x) + uf 1 (x), 



with 



Then 



fa 



J),[/i,[/i.[/i,/o]]](o 



span R 2 . Hence our system satisfies the Lie algebra rank condition at (0,0) € 
R 2 x R. Moreover, if h e Br{f) with 5o(h) odd and 5i(h) even, then h(0) = 0. 
Hence our system satisfies the Hermes condition and therefore is small-time locally 
controllable. 

Example 3.35. Let us go back to the problem of the control of the attitude 



of a rigid spacecraft. In this example our control system is (3.12) with bx,...,b m 
independent and 1 Sj m Sj 3. Then the following results hold. 

- For in = 3, as we have seen in Section 3.1 (page 129), the control system 



(3.12) is small-time locally controllable. Bernard Bonnard in |61j (see also 



the paper [137] by Peter Crouch) has also proved that the control system 



(3.12) is globally controllable in large time (that is, given two states, there 
exist a time T > and an open-loop control u € L°°(0,T) steering the 



control system (3.12) from the first state to the second one). His proof relies 
on the Poincare recurrence theorem, as previously introduced by Lawrence 
Markus and George Sell in 344], and by Claude Lobry in [334] . For a 
recent presentation of this result, we refer to [189, Th.II.23, Chapitre II, 
pages 139-140]. 
For m = 2, the control system (3.12\ satisfies the Lie algebra rank condition 



(3.81) 



at (0, 0) e K 6 x K 2 if and only if (see [53 IT3T] ) 

Span {6i, 62, S(uj) J~ x io; u) € Span {&i,&2}} 



Moreover, if (3.81) holds, then: 



The control system (3.12) satisfies Sussmann's condition S(l), and 
so is small-time locally controllable; see [272] by El-Yazid Kera'i. 
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- The control system (3.12) is globally controllable in large time; this 
result is due to Bernard Bonnard [61] , see also [137] , 
- If m = I, the control system (3.12) satisfies the Lie algebra rank condition 
at (0, 0)£l 6 xli/ and only if (see PS H37] ) 

(3.82) Span{b u S(bi)J- 1 b- L S(u>)J- 1 u>; cue Span {buSib^J- 1 ^}} = R 3 . 

Moreover, 



The control system (3.12) does not satisfy a necessary condition for 
small-time local controllability due to Hector Sussmann [468 , Propo- 
sition 6.3] (see the next theorem) and so it is not small-time locally 
controllable. This result is due to El-Yazid Kerai [272j . 



- If (3.82) holds, the control system (3.12) is globally controllable in 
large time. This result is due to Bernard Bonnard [61 ; see also 
|137j by Peter Crouch. 

For analysis of the small-time local controllability of other underactuated mechanical 
systems, let us mention, in particular, [402] by Mahmut Reyhanoglu, Arjan van der 
Schaft and Harris McClamroch and Ilya Kolmanovsky. 

With the notations we have introduced we can also state the following necessary 
condition for small-time local controllability due to Gianna Stefani [463 , Theorem 
1], which improves a prior result due to Hector Sussmann [468, Proposition 6.3]. 

Theorem 3.36. Let us assume that /o and f\ are analytic in an open neigh- 
borhood tlofOe K" and that 

(3.83) /o(0) = 0. 
We consider the control system 

(3.84) i = /o(a;) + u/i(s), 

where the state is x G £7 and the control is u € R. Let us also assume that the 
control system (3.84) * s small-time locally controllable. Then 



(3.85) adfJ {<S) € Span {/i(0); h e Br(f); 5 x (h) ^ 2k - 1}, Vfc e N \ {0}. 



3.11 



on page 
1. 
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(Let us recall that ad? /o, p 6 N, are defined in Definition 
The prior result [468; Proposition 6.3] corresponds to the case k 

Sketch of the proof of Theorem |3.36| We follow Hector Sussmann's proof 
of [468, Proposition 6.3]. Let us assume that (3.85) does not hold for k = 1. One 



first proves the existence of an analytic function on a neighborhood V of such 
that 



(3.86) 
(3.87) 
(3.88) 
(3.89) 



To prove the existence of such a 
on a neighborhood of such that 

(ffi(0),.. 



0(0) = o, 
0'(O)(/i(O)) = 0, Vh E Br(/) such that 6i(h) < 1, 

0'(O)([/i,[/i,/o]]) = l, 
0'(i)(/i(x)) = 0, Vz e V. 

let <7i , . . . , g n be analytic vector fields defined 



■ iffn(0)) is a basis of '. 
5i = h 
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and, for some k € {1, . . . ,n — 1}, 

(gi(0),...,g k (0)) is a basis of Span {/i(0); he Bv(f);5i(h) sC 1}, 
9k+\ = [/i,[/i,/o]]- 



Let us denote by ^i the flow associated to gi (see (3.20)). Then there exists a 
neighborhood V of such that every i£V has a unique expression of the following 
form: 

x = ^ov I ^o...o<"_- 1 °^r(o). 



Then it is not hard to check that, if we define cf> by 4>{x) := tk+i, one has (3.861, 
( pT87) ; fl3~88] ) and ( [3~89 l. 

For the next step, let us introduce some notations. Let r € N \ {0}. For a 
multi-index / = (ii, . . . ,i r ) € {0,l} r , let // be the partial differential operator 
defined by 

(3-90) f I (6) = L fii L fi2 ...L fir _ i L fir e. 



In ( |3.90| and in the following, for X = (Xi, . . . , I„) tr : E" -> E™ and V : R" -» R, 
LxV : E™ — > E denotes the (Lie) derivative of V in the direction of X: 

(3.91) L X V :=Y,X l — = V'(x)X(x). 

For u e L°°(0, T), r G N \ {0} and multi-index I = (i u . . . ,i r ) E {0, l} r , we define 
u / €L°°(0 ) T)by 

Ul(t r )= j j j ... j j Ui r (t r _i)u ir _ 1 (t r _ 2 ) 

Jo Jo Jo Jo Jo 

. . . u l2 {ti)u il (to)dt dti . . .dt r ^ 2 dt r -i, Vt r e [0,T], 

with 

u {t) = 1 andwi(t) = w(t), £ e (0,T). 

(We have slightly modified the notations of [468j : what we call here uj(t) is 
denoted J Q uj in 468J; see [468, (3.3)].) Let £ be the set of all multi-indices 
/ = (?i, . . . , i r ) € {0, 1} T with r £ N \ {0}. The next step is the following proposi- 
tion. 

PROPOSITION 3.37 ( |468l Proposition 4.3]). Let 4> : E™ — > E &e an analytic 
function on a neighborhood of in E™ suc/i i/iai ^(0) = 0- TTien i/iene exists T > 
smc/i i/iai, /or every u € L°°(0,T) wzi/i ||m||l~(o,t) ^ 1; one ftas 

(3.92) Y, M*)l K/' W) (°)l < + °°> V * e M> 

/G£ 

(3.93) 0(s(t)) = Y, «/(*) (// ($) (°) . Vi e [0,T], 

/G£ 

where x : [0,T] — > E n is i/ie solution of the Cauchy problem 

x = fo{x) + u{t)f 1 (x),x{0)=0. 
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We omit the proof of this proposition, which is also explicitly or implicitly 
contained in [1731 1174] by Michel Fliess, [286] by Arthur Krener, [73 by Roger 
Brockett (see also [75] ) and [193] by Gilbert Elmer. It can now be found in classical 
books in nonlinear control theory; see e.g. [2471 Section 3.1]. Let us emphasize 
that the right hand side of (3.931 is the Chen-Fliess series, introduced by Kuo-Tsai 
Chen in |90j for geometrical purposes, and by Michel Fliess in |174j for control 
theory. 

Let us analyze the right hand side of (3.931. Using (3.831 (which is always 
assumed and is in any case implied by the small-time local controllability of the 
control system (3.84)), we get 

(3.94) (/i(0))(O) = O,V/ = (» 1 



,i r ) G £ with i\ = 0. 



By (3.891, 



(3.95) //(</>) = 0, VI = {h,...,i r ) G £ with i r = 1. 
Let us now assume that 

(3.96) I = («i, . . . , i r ) G £ with ii = 1 and ik = 0, Vfc G {2, . . . , r}. 
Let us check that we then have 

(3.97) (//(0)(O)=O. 

For k G N \ {0}, let 0& be the multi-index (ji, . . . , jk) with ji = for every I G 
{l,...,fc}. Then 

(3.98) f I (<j>) = L f J 0r _M=L [flJo] f 0r _M+Lf L f J 0r _ 2 (ct>). 
But (3.83) implies that 

L fo L fl fo„_M(V) = 0- 



(3.99) 



Similarly to (3.981, we have 

(3.100) %,/ o ]/o r - 2 (0) = %i,/o],/o]/Or-s($ + L /o L [/l,/o]/0.- 3 (<? i )- 



As for ( |3.99| , ( |3.83[ ) implies that 

£/o£[/L,/.]/Or-.M(0)=0. 

Continuing on, we end up with 

//(M0) = (-l) r - 1 (i ad r-l /l 0)(O), 



which, together with (3.871, implies that 
(3.101) //(0(O) = 0. 

Let us now study the case I = (1,1,0). Let v G C ([0, T]) be defined by 



v {t) := / u(r)dr, Vi G [0,T]. 
Jo 
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We have 



(3.102) 



«(1,1,0)(*3) 



t 3 ft? /■*! 



JO Jo 

t 3 rt 2 



u(ti)u(to)dtodtidt2 
v(t\)v{ti)dt\dt2 



"'O 

*3 



v(t 2 ) 2 dt 2 



From (3.881 and (3.102), we get 



(3.103) 



U(i,i,o)(t)(/(i,i,o)(0))(O) 



1 



v(t) dr. 



Finally, let us assume that I = (ii, . . . , i r ) G £ is such that 
(3.104) there are at least two I G {1, . . . ,r} such that ii = 1, 



(3.105) 
(3.106) 



i\ = 1 and i r = 0, 
r > 4. 



Let us write J = (l,0fe, 1, J) with J := (ji, . ■■,ji) 6 J, fc € N and the convention 
(1,0 ,1, J) := (1,1, J). We have / = r - 2 - k ^ 1, / + fc ^ 2 and jj = 0. Then after 
computations which are detailed in [468, pages 708-710], one gets the existence of 
C > independent of / such that, for every T > 0, for every t G [0,T], and for 
every u e L°° ((0 , T) ; [-1,1]), 



(3.107) M*)||(//(0))(O)KC 



/ + /c + 2 



l+k _ 1 (l + k)l(l+k + 2Y- 

l\k\ 



v(t) dr. 



Finally, from (3.93), (3.94 1, (3.951, (3.971, (3.103) and (3.1071, one gets the existence 



of T > such that, for every te [0, T] and for every u € L°°((0, T); [-1, 1]), 



(3.108) 



<Kx(t))>-J v(T) Z dT 



(see 068, page 710] for the details). Hence the control system (3.84 1 is not small 



time locally controllable. This concludes the sketch proof of Theorem |3.36| for the 
case k = 1. ■ 



Let us give an example of application of Theorem |3.36| 

Example 3.38. In this example n = A and m = 2 and the control system we 
consider is given by 

(3.109) X\ = X 2 , X2 = —Xi + U, ±3 = X4, Xi = —x 3 + 2xiX2, 

where the state is (xi,X2,X3,X4) tr G K 4 and the control is u G K. Hence 

(3.110) f (x) = {x 2 , -Xi,Xa, -x 3 + 2x 1 x 2 ) tr , 

(3.111) /i(a;) = (0,l,0 > 0) tr . 
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Straightforward computations lead to 

(3.112) 

(3.113) 

(3.114) 

(3.115) 

(3.116) 

(3.117) 

(3.118) 



(1,0,0, 2a;i)' r , Vie 



[fufo](%) = ^,u,u,^lj 

ad k f J {x) = (0, 0, 0, 0)* r , Vfc G N \ {0, 1}, Vx G R 4 , 

4 t / 1 (o) = (-if(o,i,o,o)' r ,VfceN, 

a^ +1 /i(0) = (-l) fe+1 (l,0,0,0) tr , Vfc G N, 
ad 2 f J 1 {x) = {0 1 -l,2x ll 0) tr ,Vx={x 1 ,x 2 ,x 3 ,x 4 ) tr em. 4 

[[A,/oW/ /i](o) = (o,o,2,or, 

[/o,[[/i,/o],a4 /i]](0) = (0,0,0,2)*'". 
A/oie that, by {3.111$ , {3.112$ , {3.111$ and {3.118$ , 

Span{fx(0),[fxJ )(0),[[fxJo),acF f Jx)(0),[f ,[[fx,f },ad} fx}](0)} 



which implies that the control system (3.109) satisfies the Lie algebra rank condition 



at (0,0) G R x R. Equation (3.113) shows that assumption (3.85) is satisfied. 



Hence it seems that one cannot apply Theorem 3.36 However, letting 



2/i ■= xx, 2/2 := x 3 , 2/3 ■= X4, v := x 2 , 
one easily checks that the small-time local controllability of the control system 



(3.109) at (0,0) 6 K x 1 implies the small-time local controllability at (0,0) G 



R x R of the control system 
(3.119) yx = v,y 2 



2/3, 2/3 



-2/2 + 2^2/1, 



where the state is y 

C7°°(R r 



(2/1,2/2,2/3) 



• R and the control is v G M 

gx G C°°(R 3 ; R 3 ) and g G C°°(R 3 x R; R 3 ) be defined by 

2/o(2/) := (0,2/3,-2/2)"", 2/i(2/) := (l,0,2 yi ) tr , 



Lei (7 G 



27(2/, *>) : = £7o(y) + vgx(y), V(y, u) G R 3 x 



Hence the control system (3.119) can be written 



y = 9o(y) + vgx(y) = g(y,v). 

Now, straightforward computations give 

(3.120) [ 5 i,2/o](2/) = (0,22/ 1 ,0) fr , 

(3.121) ad 2 ai g (0) = (0,2,0) tr , 

(3.122) od* 5 i(0) = (0,0,0) tr , Vfc G N\ {0}. 



Since gx(0) = (l,0,0) tr , {3.122$ gives us (see also Exercise \3J!7\ on page \l42$ 

(3.123) Span {h(0); h G Br{g); 81(h) ^ 1} = R(l, 0, 0)* r . 

Equation (3.121), together with (3.123), shows that (3.85) does not hold for fc = 1 



and for the control system (3.119). Hence, by Theorem 3.36 the control system 
(3.119) is not small-time locally controllable at (0,0) G R 3 x R. This implies 



that the original control system (3.109) is not small-time locally controllable at 

(0,0)GR 4 xR. 



In Example 6.4 



on page 



190 we will see that our control system (3.109) is in 



fact controllable in large time. 
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Remark 3.39. One can find other necessary conditions for local controllability 
in [226 by Henry Hermes, in [231J by Henry Hermes and Matthias Kawski, in [270 
by Matthias Kawski, in 463J by Gianni Stefani, in [468J by Hector Sussmann, and 
the references therein. 



3.5. Global results 

To get global controllability results is usually much more complicated than to 
get local controllability results. There are very few theorems leading to global con- 
trollability and they all require very restrictive assumptions on the control system. 
The most famous global controllability result is the Rashevski-Chow theorem (The- 



orem 3.18 on page 134 1 which deals with driftless control affine systems. Let us 
mention two other important methods. 

1. A general enlarging technique, due to Velimir Jurdjevic and Ivan Kupka 
[2591 1260| , which allows us to replace the initial control system by a control 
system having more controls but the same "controllability" ; see also |153j 
by Rachida El Assoudi, Jean-Paul Gauthier and Ivan Kupka as well as 
[2581 Chapter 6, Section 3] by Velimir Jurdjevic, and [62, Section 5.5] by 
Bernard Bonnard and Monique Chyba. 

2. A method based on the Poincare recurrence theorem. It was introduced 
by Lawrence Markus and George Sell in |344j . and by Claude Lobry in 
|334j . For a recent presentation of this method, we refer to [189, Th.II.23, 
Chapitre II, pages 139-140] and to [2581 Theorem 5, Chapter 4, p. 114]. 

In this section, we present two more methods which allow us to get global control- 
lability. These methods are less general than the methods previously mentioned, 
but they turn out to be useful also for infinite-dimensional control systems. 

- The first one deals with perturbations of linear control systems. It relies on 
a method which has been introduced by Enrique Zuazua in [5151 1516] to 
get global controllability results for semilinear wave equations. We detail 
it in Section l3.5.1l 

- The second one relies on homogeneity arguments. For example, it shows 
that if a "quadratic control system" is locally controllable, then any control 
system, which is a perturbation of this quadratic control system by a linear 
term, is globally controllable. This has been used in various papers to 
get global controllability results for the Navier-Stokes equations from the 



controllability of the Euler equations (see Remark 3.47 on page 156 



references therein). We detail this second method in Section 3.5.2 



well as Section |6.2.2.2] — in particular, Remark |6.18| on page |201 — and the 



3.5.1. Lipschitz perturbations of controllable linear control systems. 

We consider the control system 

(3.124) x = A(t,x)x + B(t,x)u+ f(t,x), t€ [T ,Ti], 

where, at time t, the state is x(t) £ R" and the control is u(t) € R m . We assume 
that A : [T ,Ti] x R™ -» £(R";R n ), B : [T ,Ti] x 1" -> £(R m ;R") and / : 
[T , T±] x R" — > R n are smooth enough (for example, assuming that these maps are 
continuous with respect to (t, x) and locally Lipschitz with respect to x is sufficient). 
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We also assume that 

(3.125) ^eL oo ((T ,T 1 ) xI";£(R";r)), 

(3.126) B G L°°((T ,Ti) x R™;£(R m ; R n j), 

(3.127) /eL°°((T ,Ti) xR";l"). 

For z G C°{[T , Ti]\ K"), let us denote by € z G M n , n {R) the controllability Gramian 
of the time- varying linear control system 

x = A(t, z(t))x + B(t, z(t))u, t G (T , Tx), 

(see Definition 1.10 on page pi). 

The goal of this section is to prove the following theorem. 

Theorem 3.40. Let us also assume that for every z G C°([T ,T 1 ];W n ), € z is 
invertible and that there exists M > such that 



(3.128) 



KC 1 



z \M n , n { 



<M, VzeC°([r ,Ti];R n ). 



T/ien the control system (3.124) is globally controllable (on [T Q ,Ti]): for every 
x° G R" and for every x 1 G R", there exists u G L°°((T , Ti); R m ) suc/i that the 
solution of the Cauchy problem 

x = A(t, x)x + B(t, x)u(t) + f(t, x), x(T ) = x° 

satisfies 

x{Tx) =x\ 



Proof of Theorem |3.40| As we have said, we follow a method introduced by 
Enrique Zuazua in [515, 516 . Let x° G R" and x 1 G R". Let us define 

t ■■ z g c^aro.rjjR") >-> t{z) g c^aro.rjjR") 

in the following way Let u z G L 2 ((Tq, Ti); R m ) be the control of minimal L 2 -norm 
which steers the time-varying linear control system with a remainder term 

x = A(t, z{t))x + B{t, z{t))u + f{t, z(t)), t G [T , Ti], 

from the state x° to the state x . Then T(z) := x is the solution of the Cauchy 
problem 

(3.129) x = A(t, z{t))x + B(t, z{t))u z {t) + f(t, z(t)), x(T ) = x°. 

Let us point out that such an u z exists and its expression is the following one: 

(3.130) u z {t) = B(t) te iS(ri, t)* 1 ^ 1 



(x 1 



R z (T uT )f(T,z(T))dT - R z {T x ,T Q )x°),t G (T 0) Ti 



where R z is the resolvent of the time- varying linear system 

x = A{t,z{t))x,te [Tq,^], 

(see Definition |1.4| on page El. Equality (3.130) can be checked by considering the 
solution x G ct(\T , T t ]; R n ) of the Cauchy problem 



x = A{t, z{t))x + f(t, z(t)), x(T ) = 0. 
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One has (see Proposition 1.9 on page [6]) 



(3.131) 



x(T x ) 



R z (T X ,T)f(T,z(T))dT. 



Clearly u z is the control of minimal L 2 norm which steers the control system 

x = A(t, z(t))x + B(t, z{t))u 



from the state x° to the state x 1 —cc(T 1 ). Hence (3.1301 follows from Proposition 1.13 
on page ^ and (3.131). 

Note that, by the definition of u z , 

x(Ti) =x 1 , 

where x : [Tb,Ti] — > R" is the solution of the Cauchy problem ( 3.129| . Clearly 

(3.132) T is a continuous map from C°([T , T^; R n ) into C°([T , T x ];R n ). 



Moreover, if z is a fixed point of T ", then u z steers the control system (3.124) from 
x° to x 1 during the time interval [T ,Ti]. By (|3.125|, (|3.126|, (|3.127|, pj28| and 



( |3.130| , there exists M x > such that 

(3.133) ll«»IU-(T 0t TO < Mi, Vz G ^([TcTx];] 



From the definition of F, ( |3.125| , ( |3.126| , ( |3.127[ ), ( |3.129[ ) and ( |3.133[ ), there exists 
M-x > such that 



(3.134) 
(3.135) 



irailc°([T„,T l]; R") < M 2 , Vz e c ffl ([r 0> r 1 ];R n ) > 
|^)(ta)-^)(ti)| 

< M 2 \t 2 - ti\, Vz G C°([T ,Ti];R n ), V(t u t 2 ) € [Tq,^] 2 . 



From (3.134), (3.135) and the Ascoli theorem (see, for example, [4191 A 5 Ascoli's 
theorem, page 369]) 

(3.136) 



^(C°([T ,Ti];R")) is a compact subset of C°{[T Q , T x ]; R"). 



From (3.132), (3.1361 and the Schauder fixed-point theorem (Theorem 
page 391 1, T has a fixed point. This concludes the proof of Theorem 3.40 
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Applying Theorem |3.40| to the case where A and B do not depend on time we 
get the following corollary, which is a special case of a result due to Dahlard Lukes 
( [3371 Theorem 2.1], [555] ). 

COROLLARY 3.41. Let A e £(R n ;R") and B e £(R m ;R") be such that the 
linear control 

x = Ax + Bu, x G R", u e R m , 
is controllable. Let f G C (R";R n ). Let us assume that f is bounded on R™. Then, 
for every T > 0, the nonlinear control system 

x = Ax + Bu + f(x), x e«. n , iiel" 1 , 

is globally controllable in time T: for every x° G R n and for every x 1 G R ra ; there 
exists u G L°°((To, T\); R") such that the solution of the Cauchy problem 

x = Ax + Bu + f(x), x(T Q ) = x° 

satisfies 

x(Ti) =x\ 
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Exercise 3.42. Prove that the assumption that f is bounded cannot be removed. 
(Hint. Take n = 2, m = 1, and consider simply the following control system 

X\ = X2 — f(x),X2 = U With f{x) = X2-) 



Exercise 3.43. Prove that the conclusion of Corollary \3.41\ holds if the as- 
sumption "f is bounded on R™ " is replaced by the assumption 

(3.137) \f{x 2 ) - fix 1 )] < e\x 2 - a^Vfa^ar 1 ) G l n x R n , 

provided that e > is small enough (the smallness depending on A and B, but not 
on x° and x 1 ); see also [337[ Theorem 2.2] . 

Exercise 3.44 (See [2231 Theorem 1.2] by Henry Hermes). Let T > 0. Let us 

consider the following control system 

(3.138) x = f(t, x(t)) + B(t)u, t e (0, T), 

where the state is x G R n and the control is u G R m . Let us assume that f G 
C l ([0,T] x K";K n ) and B G L°°((0, T); £{R m ; R")). Let us also assume that there 
exists C > such that 



\f(t,x)\^C,\/(t,x)e[0,T]xR n , 

f x^Bi^BitY'xdt^C-^xf^xe 
Jo 



Prove that the control system (3.138) is globally controllable in time T > 0. 



3.5.2. Global controllability and homogeneity. In this section we show 
how some simple homogeneity arguments can be used to get global controllability. 

We do not try to present the most general result; our goal is just to present the 
method on a simple case. 

Let A G £(«";»"), B G £(R m ;R") and F G C x (R n ;K n ). We assume that 
there exists p£N such that 

(3.139) p>l, 

(3.140) F(\x) = X p F{x), VA G (0,+oo), Va; G R n . 
Our control system is 

(3.141) x = Ax + F(x) + Bu, 
where the state is x G R n and the control is u G W n . 



Our idea is to get a global controllability result for the control system (3.141) 
from a local controllability property of the control system 

(3.142) x = F{x) + Bu. 



For the control system (3.142 I, the state is again x G R n and the control is u G K m . 
This local controllability property, which will be assumed in this section, is the 
following one: there exist T > 0, p > and a continuous function u : B p —* 
L x ((0,r));R m ) such that 

(3.143) ((£ = F(x) + Bu(a)(t),x(0) = a) => (x(f) = 0)), Va G B p . 

Here and everywhere in this section, for every fi > 0, 

B p := {x G R"; |x| < n}, B p := {x G R"; \x\ < M }. 
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Note that, as we will see later on (Proposition 11.24 



on page 



3011, for every 9 G 



[0, 1], this controllability property is implied by the Sussmann condition S(6) (see 
Definition 



3.31 



on page 



143)); see also Open Problem 11.25 



on page 



301 



Remark 3.45. From ( |3.139| and ( |3.140[ ), one gets 

(3.144) F(0) = 0, 

(3.145) F'(0) = 0. 



of this control system is the 



Hence (0,0) G W 1 x K m is an equilibrium of the control system (3.1421 and the 
linearized control system around (0, 0) G 1™ x 
linear control system 

(3.146) x = Bu. 



Therefore, if B{R m ) ^ 
is not controllable. 



(in particular, if m < n), this linearized control system 



Our goal is to prove the following theorem. 



Theorem 3.46. Under the above assumptions, the control system (3.14-1) is 
globally controllable in small time. More precisely, for every xq € W 1 , for every 
x\ G K", and for every T > 0, there exists u G L 1 ((0,T); K m ) such that 

(x = Ax + F(x) + Bu(t), x(0) = x°) => (x{T) = x 1 ). 

Proof of Theorem \3A6\ Let a; G K", Xi G W 1 and 77 > 0. Let $ be the 
map defined by 

[O,??] x B p -» W 1 
(e,a) 1-* x{0), 

where x : [0,T] :— > R n is the solution of the Cauchy problem 



v Ax + F(x) + Bu(a)(t), x(T) 



ex 



By (3.1391 and (3.1431, if r\ > is small enough, $ is well defined. We choose such 



an r\. Then $ is continuous on [0, rj\ x B p and 

(3.147) $(0,a) = a, Va G B p . 
In particular, 

(3.148) degree ($(0, ■), B p , 0) = 1. 

For the definition of the degree, see Appendix |BJ Thus there exists 771 G (0, 77] such 
that 

(3.149) degree {$>{e,-),B p ,ex f) ) = 1, e G [0,771]. 
Let 

(3.150) f = nf~ 1 f, 

(3.151) rG(0,f], 

, . .VCp-i) 
(3.152) 



By ( |3.150| , | |3.15ip and (|3_152j) 
(3.153) 



-(J) 

£G (0,771]. 
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lo5 



From (3.1491, (3.153) and the homotopy invariance of the degree (see Proposi- 
on page 387 1 , there exists a £ B p such that 

$(e, a) = ex . 



tion 



B.8 



(3.154) 

Let x : [0, T ] 

(3.155) 

(3.156) 



t n be the solution of the Cauchy problem 
x = e p ~ l Ax + F(x) + Bu(a)(t), 
x(T) =ex 1 . 



By (3.1541, one has 

(3.157) 

Let x : [0, r] 



(3.158) 



r and u : [0, r] 



x{t) 



£P~ 



x(0) = ex . 

R m be defined by 

1 
,u(t) 



u(a) . 

£ p v I l £ p_l 



We [0,r]. 



From (3.1401, (3.1551 and (3.158), we get 



i; = Ax + F(x) + Bu(t). 



From fl3.152| , ( |3.156| and (|3_158j), one has 

ic(t) = a; . 



From (3.1571 and (3.1581, one gets 



x(0)=x°. 



This shows that one can steer the control system (3.141) from x° to x 1 in an 
arbitrary small time. It remains to prove that one can make this motion in an 
arbitrary time. For that, let T > 0. Applying the previous result with x 1 = 0, one 
gets the existence of T ^ T/2 and of u$ G L 1 ((0,T o );IR m ) such that the solution 
of the Cauchy problem 

x = Ax + F(x) + Bu (t), x(0) = x°, 

satisfies 

x(T ) = 0. 
Similarly, applying the previous result with x° = 0, one gets the existence of T\ ^ 
T/2 and of U\ £ L 1 ((0, Ti); K m ) such that the solution of the Cauchy problem 

x = Ax + F(x) + Bui(t), x(0) = 0, 

satisfies 

x(Ti) =x 1 . 
Finally, let u £ L 1 ((0,T)',W n ) be defined by 

u(t)=u (t),t£(0,T ), 
u(t)=0,t£(T ,T-T 1 ), 

u{t) = u 1 {t-T + T 1 ), t£ (T-Ti,T). 

(Note that, since To ^ T/2 and T\ ^ T/2, one has Tq Sj T — T\.) Then (let us 
recall (3.144)) the solution of the Cauchy problem 

x = Ax + F(x) + Bu(t),x{0) = x°, 

satisfies 

x{T) = x 1 . 
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This concludes the proof of Theorem |3.46[ 



Remark 3.47. The above argument is similar to the one introduced in [111] 
in the framework of control of partial differential equations to get a global control- 
lability result for the Navier-Stokes from a local controllability result for the Euler 



equations; see also [123, 188, 9, 446J as well as Section 6.2.2.2 



3.6. Bibliographical complements 

There are many books on the subject treated in this chapter. Let us, for exam- 
ple, mention the following classical books, where one can also find more advanced 
results: [8] by Andrei Agrachev and Yuri Sachkov, |247j by Alberto Isidori, |258] by 
Velimir Jurdjevic, [361J by Richard Montgomery and 376 by Henk Nijmeijer and 
Arjan van der Schaft. In these books, one can find many results of controllability 
relying on the Lie brackets approach. For books dealing with more specific prob- 
lems that one encounters in robotics, let us mention, in particular, [18 by Brigitte 
d'Andrea-Novel, [82 edited by Carlos Canudas-de-Wit, [303j edited by Jean-Paul 
Laumond, [436] by Claude Samson, Michel Le Borgne and Bernard Espiau. 

There is a subject that we have not at all discussed, namely the problem of 
optimal control. Now one wants to go from x° to x 1 in an optimal way, that is, 
the way that achieves some minimizing criterion. This if of course an important 
problem both from the mathematical and practical points of view. There is a 
huge literature on this subject. For the Pontryagin [390 maximum principle side 
(open- loop approach), let us mention, in particular, the following books or recent 
papers: 

- [62 by Bernard Bonnard and Monique Chyba, on singular trajectories and 
their role in optimal control theory. 

- [63 by Bernard Bonnard, Ludovic Faubourg and Emmanuel Trelat on the 
control of space vehicle. 

- |100j by Francis Clarke, Yuri Ledyaev, Ronald Stern and Peter Wolenski 
as well as [96 by Francis Clarke, for the use of nonsmooth analysis to get 
generalizations of the classical maximum principle. 

- [290 by Huibert Kwakernaak and Raphael Sivan, a classical book on linear 
optimal control systems. 

- [309 by Ernest Lee and Lawrence Markus, one of the most classical books 
on this subject. 

- |440j by Atle Seierstad and Knut Sydsaster, with a special emphasis on 
applications of optimal control to economics. 

- [470] by Hector Sussmann, where one can find numerous generalizations of 
the classical maximum principle. 

- [481] by Emmanuel Trelat, which also deals with classical materials of 
control theory. 

- |495j by Richard Vinter, which deals with optimal control viewed from the 
nonsmooth analysis side. 

- [509] by Jerzy Zabczyk, which deals to finite and infinite-dimensional con- 
trol systems. 

For the Hamilton- Jacob i side (closed- loop approach), let us mention, besides 
some of the above references, the following books: 
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by Guy Barles and [331 j by Pierre-Louis Lions, both on viscosity 
solutions of the Hamilton-Jacobi equation (a notion introduced by Michael 
Crandall and Pierre-Louis Lions in |135j ). 

[64] by Ugo Boscain and Benedetto Piccoli, with a detailed study of the 
optimal synthesis problem in dimension 2. 

|81j by Piermarco Cannarsa and Carlo Sinestrari, which shows the impor- 
tance of semiconcavity for the Hamilton-Jacobi equation. 
[510] by Jerzy Zabczyk, which deals with stochastic control in discrete 
time. 



CHAPTER 4 



Linearized control systems and fixed-point 

methods 



In this chapter, we first consider ( Section |4.1| and Section 4.2 I the problem of the 



controllability around an equilibrium of a nonlinear partial differential equation such 
that the linearized control system around this equilibrium is controllable. In finite 



dimension, we have already seen (Theorem 3.8 on page 128 1 that, in such a situation 



the nonlinear control system is locally controllable around the equilibrium. Of 
course in infinite dimension one expects that a similar result holds. We prove that 
this is indeed the case for the following equations. 

- The nonlinear Korteweg-de Vries equation. In this case one can prove 
the local controllability of the nonlinear control equation (Theorem 4.3 on 
page 161 1 by means of a standard fixed-point method. 

- A hyperbolic equation. In this case there is a problem of loss of derivatives 
which prevents the use of a standard fixed-point method. One uses instead 
an ad-hoc fixed-point method, which is specific to hyperbolic systems. 

- A nonlinear one-dimensional Schrodinger equation. There is again a prob- 
lem of loss of derivatives. This problem is overcome by the use of a Nash- 
Moser method. 

Of course these nonlinear equations have to be considered only as examples given 
here to illustrate possible methods which can be used when the linearized con- 
trol system around the equilibrium is controllable: these methods actually can be 
applied to many other equations. 

Sometimes these methods, which lead to local controllability results, can be 
adapted to give global controllability results if the nonlinearity is not too strong 
at infinity. We have already seen this for finite-dimensional control systems (see 



Section 3.5 I. In Section 4.3 we show how to handle the case of some nonlinear 
partial differential equations on the example of a nonlinear one-dimensional wave 
equation. 



4.1. The Linear test: The regular case 

In this section, we consider nonlinear control systems modeled by means of 
partial differential equations such that the linearized control system around some 
equilibrium is controllable. We want to deduce from this property the local con- 
trollability of the nonlinear control system around this equilibrium. On a nonlinear 
Korteweg-de Vries equation, we explain how to get that local controllability by 
means of a natural fixed-point strategy, which can be used for many other equa- 
tions. 

159 



Kill 
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We consider the following nonlinear control system 

(4.1) Vt + Vx + Vxxx + Wx = 0,t£ (0,T), xe (0,L), 

(4.2) y(t, 0) = y(t, L) = 0, y x (t, L) = u(t), t g (0, T), 
where, at time t g [0, T], the control is u(t) g M. and the state is y(t, 



:(0,L) 



Equation (4.1 1 is a Korteweg-de Vries equation, which serves to model various 



physical phenomena, for example, the propagation of small amplitude long water 
waves in a uniform channel (see, e.g., |144l Section 4.4, pages 155-157] or [502 
Section 13.11]). Let us recall that Jerry Bona and Ragnar Winther pointed out 
in [60 that the term y x in (4.1) has to be added to model the water waves when 



x denotes the spatial coordinate in a fixed frame. The nonlinear control system 



(4.1 )-(4.2) is called the nonlinear KdV equation. 



The linearized control system around (y,u) = (0,0) is the control system 

(4.3) yt + y x + vxxx = 0, xe{0,L),te (0,T), 

(4.4) y{t, 0) = y{t, L) = 0, y x {t, L) = u{t), t g (0, T), 

where, at time t, the control is u(t) g R and the state is y(t, ■) : (0,L) — > K. We 
have previously seen (see Theorem |2.25 



on page 



42 I that if 



(4.5) 



L^M := <2tt 



p + l 2 +jl 



; j,l €N\{0} 



then, for every time T > 0, the control system ( 4.3 1- ( 4.4 1 is controllable in time 



T. Hence one may expect that the nonlinear control system (4.1|-(4.2| is at least 



locally controllable if (4.5) holds. The goal of this section is to prove that this is 



indeed true, a result due to Lionel Rosier [4071 Theorem 1.3]. 

4.1.1. Well-posedness of the Cauchy problem. Let us first define the 
notion of solutions for the Cauchy problem associated to (|4.1|-(4.2 1. The same 

on page 



procedure motivating the definition (Definition 2.21 



38 ) of solutions to the 



Cauchy problem for the linearized control system (4.3 )-(4.4 1, leads to the following 
definition. 

Definition 4.1. Let T > 0, / e ^((O,! 1 ); L 2 (0, L)), y° g L 2 {0,L) and u g 
L 2 (0,T) be given. A solution of the Cauchy problem 

(4.6) yt + y x + yxxx + yy x = f,xe [o, L], t g [o, T], 

(4.7) y(t, 0) = y(t, L) = 0, y x (t, L) = u(t), t g [0, T], 

(4.8) y(0 7 x)=y o (x),xe[0,L], 

is a function y g C°([0, T]; L 2 (0, L)) D L 2 ((0,T); H l {Q, L)) such that, for every 
t g [0,T] and for every <j) g C 3 ([0, r] x [0, L\) such that 

(4.9) </>(t,0) = 4>{t,L) = x (t,O) = 0, V* g [0,r], 
one has 

(4.10) - / / {4>t + 4>x + <t>xxx)ydxdt - / u(t)<f) x (t,L)dt+ / / (j)yy x dxdt 

Jo Jo Jo Jo Jo 

fL pL fT pL 

+ / j/(r, x)4>{t, x)dx — / y°(x)(f>(0, x)dx = I I fydxdt. 
Jo Jo Jo Jo 

Then one has the following theorem which is proved in [1221 Appendix A]. 
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161 



Theorem 4.2. Let T > 0. Then there exists e > such that, for every f € 
L l {{Q,T);L 2 {Q,L)), y° £L 2 {0,L) andue L 2 (0,T) satisfying 

ll/llii((O,T);i3(0,i)) + I|J/°IU 2 (0,L) + ||w||L3(0,T) < S, 



i/ie Cauchy problem (4.6)-(4- r l)-(4-8) has a unique solution. 
The proof is rather lengthy and technical. We omit it. 

4.1.2. Local controllability of the nonlinear KdV equation. The goal 
of this section is to prove the following local controllability result due to Lionel 
Rosier. 

Theorem 4.3 f |407l Theorem 1.3]). Let T > 0, and let us assume that 

(4.11) L£N, 

with 



(4.12) 



M 



2„J j2 + P o +jl ;j,l&N\{0} 



Then there exist C > and r$ > such that for every y°,y l G L 2 (0,L), with 
II?/ ||l2(o,l) < r and l^Wmo.L) < r 0) there exist 

y€C°([0,T],L 2 (0,L))nL 2 ((0,T);H 1 (0,L)) 

and u € L 2 (0,T) satisfying (4-l)-(4-2) such that 

(4.13) y(o,-)=y°, 

(4.14) y (T,-) = y\ 

(4-15) \\u\\mo,T) < C(||2/ || L2(0 , L) + ||y 1 || ia(0 ,i)). 

on page 



Proof of Theorem 



4.3 



Let us first recall (see Remark 2.33 



481 that, 



by the controllability of the linearized controlled KdV system ( 4.3 I- (4.4 1 in time T, 
there exists a continuous linear map 

■*'" ^ L 2 (0,T) 

u 



T: L 2 (0,L) 

y 1 



such that the solution y G C ([0, T]; L 2 (0, L)) of the Cauchy problem 

Vt + Vx + Vxxx = 0, (t, x) e (0, T) x (0, L), 

y(t, 0) = y{t, L) = 0, y x (t, L) = u(t), t e (0, T), 

y{0,x) = 0,xe{0,L), 



satisfies 
Let 



y{T 1 x)=y 1 (x),xe (0,L). 



i?:=C°([0,T];L 2 (0,L))nL 2 ((0,T);iy 1 (0,L)) 
endowed with the norm 

112/115= Max{|| 2/ (i,.)|| L2(O)L) ;te[0,T]}+ fjf ||y(t,-)lliP(«Mi) 



di 
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Let us denote by y the continuous linear map 

L2( ,T) _> C°([0,T];L 2 (0,L)) 

where y is the solution of 

Vt + V> + 2/^xx = 0, (t, x) e (0, T) x (0, L), 
y(t, 0) = j/(t, L) = 0, y x {t, L) = u(t), t e (0, T), 

! /(0,i) = I ie(0,L) 



(see Theorem 2.23 



on page 



39 ) Proceeding as in the proof of Proposition 2.26 



page |42| one can check that y € B and that the linear map y is continuous from 
L 2 (0,T) into B; see [4071 Proof of Proposition 3.7] for the complete details). 
Let S be the continuous linear map 



L 2 (0,L) 

y° 



B 

y, 



where y is the solution of 

yt + y x + yxxx = o, (t, x) e (0, T) x (o, L), 

y{t,0) = y(t,L) = 0, y x {t,L) = 0, t £ (0,T), 
2 /(0,x) = J / (x),a;e(0,L); 



see Proposition |2.26| on page |42| 

Let ^ be the continuous linear map 

L\{Q,T)-L\Q,L)) -> B 
/ ^ #, 

where y is the solution of 

(4.16) yt + y x + y xxx = f, (t, x) € (0, T) x (0, L), 

(4.17) y(t, 0) = y(t, L) = 0, y x (t, L) = 0, t € (0, T), 

(4.18) j(0,i) = 0,ie(0,L). 



Of course the definition of "y is a solution of (4.16 )-( 4.17 )-( 4. 18 )" is obtained by 
forgetting the term yy x in Definition |4.1| Then the uniqueness of y follows from 
Theorem |2.23| on page |39| For the existence part: 

1. One first treats the case where / € C 1 ([0, T]; L 2 (0, L)) by applying Theo- 
rem |A.7| on page |375| 

2. Then one gets the estimate ||y||s ^ C||/IIl 1 ((o,t);L 2 (o : £)) by proceeding as 
in the proof of (12.141} and (12 142b (see Proposition |2.26| on page |42J) . 



3. One finally treats the general case by using the density of C 1 ([0, T]; L z (0, L)) 
inL^O.T);! 2 ^,!)). 

Let $ be the nonlinear map 

L 2 ((0,T);H\0,L)) -> L 2 ((0,T);H\0,L)) 
y (-*■ z 

where 

z : = Sy° + y o IV - (Sy°)(T, ■) + 9(yy x )(T, •)) - 9{yy x ). 
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!(>:', 



Then, after some lengthy but straightforward estimates, it is not too hard to check 
that there exists K > independent of y G L 2 ((0, T); H l (Q, L)), of y° G L 2 (0,L) 
and of y 1 G £ 2 (0, L) such that 

(4.19) ||3 r (y)||ia(( 0l T) i Hi(0,i)) 



(4.20) ||3 r («)-?(y)||^((0,T);ffi(0,L)) 

< #l|z - y|U 2 ((0,T);Hi(0,i))(ll 2; IU 2 ((0,T);Hi(0,L)) + ||y|U»((0,T);Hi(0,I,)))- 

We take 



1 3i? 2 

4K' 2 



(4.21) 

Let y° G £ 2 (0,L) and j/ 1 G £ 2 (0,L) be such that 

(4.22) ll2/°IUw) < r and h l hHo,L) < r. 

Let 

S fl := {y G L 2 ((0,T); H\0,L)y, \\y\\m(o,T).,m(o,L)) < R} . 
The set B R is a closed subset of the Hilbert space L 2 ((0, T); iJ^O, L)). From (14.19 I 



(4.201, (4.21) and (4.221, we get that 



3(B R ) C B R , 

\\${z) - 3 r (y)||i2((o,T) ! j?i(o,L)) < 2" 2 ~ ^II^CCo.^iffHo.i))' v (^) e s fl- 

Hence, by the Banach fixed-point theorem, 3" has a (unique) fixed point in Br. 
But, since y is a fixed point of 'S, the solution of the Cauchy problem 

Vt + Vx + Vxxx + VVx = 0, (£, a;) G (0, T) x (0, L), 

y(t, 0) = y{t, L) = 0, y x (i, L) = u(t), t G (0, T), 

y(0,x) = ? / (x), a :G(0,L), 



with 

(4.23) 

satisfies 



u := T(y 1 - (Sy°)(T, •) + *(yy x )(T, •)) G L 2 (0,T), 



y(T,-) = y 1 . 



Moreover, by (4.19), (4.211 and the fact that y G B R , 

(4.24) ||y|U»((o,T);*W)) < 3^(ll2/°IU 2 (o,L) + H^IU^o.i))- 



From (4.23) and (4.24), one gets the existence of C > 0, independent of y° and y 1 



satisfying (4.221, such that 

Hl»(o,D < cr(||yV (0>i) + l|y 1 ||L 2( o,L))- 
This concludes the proof of Theorem |4.3| 



Hi-1 
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Exercise 4.4. This exercise is the continuation of Exercise \2.3J\ on page\ 
Let L > and T > 0. We consider the following nonlinear control system: 

(4.25) y t + y x + J y(t,s)ds+( [ y(t,s)ds] = 0, t G (0,T), x G (0,L), 

(4.26) 



i/(t,o) = u(*),te(o,r), 



where, at time t G [0,T], i/ie state is y{t,-) G L 2 (0,L) and the control is u{t) G IK. 
For y° G L 2 (0,L) and u G L 2 (0,T), one says that y : (0,T) x (0,L) -> R is a 
solution of the Cauchy problem 

(4.27) y t + y x + [ y{t,s)ds+( [ y{t,s)ds) = 0, t G (0,T), x G (0,i), 



(4.28) j/(t J 0)=u(t) > tG(0 > r). 

(4.29) 2/(0 ):C )=y (cc),zG(0,L), 

i/j/G<?°([0,T];Z 2 (0,£)) and i/ 

0(i, s)ds)ydxdt 

~L 



o ./o 



u{t)c/)(t,0)dt ■ 



(j)(t,x) I / y(t,s)ds ) dxdi 
i) ^o \-/o 

y(r,x)<p(T,x)dx - 



y u (x)(j){0,x)dx = 0, 



for every r G [0, T] and for every <fi G C 1 ([0,T] x [0,L]) smc/i i/iai 

</>(£,£) = 0, ViG [0,T]. 

_/. Prove that, for every u G L 2 (0,T) and for every y° G L 2 (0,L), the Cauchy 
problem (4-21)-(4-28)-(4-29) has at most one solution. 

2. Prove that, there exist E\ > and C4 > (depending on T and L) such 
that, for every u G L 2 (0,T) and for every y G L 2 (0,L) such that 

IMU 2 (0,T) + ||j/°||i3(0,i) < £i> 



i/ie Cauchy problem (4-27)-(4-28)-(4-29) has a solution y and this solution 
satisfies 

\\y\\c°([0,T\;L»(O,L)) < C^GMIi^O.T) + \\y°\\^(0,L))- 

3. In this question, we assume that T > L. Prove that the control system is 
locally controllable around the equilibrium (y e , u e ) := (0, 0). More precisely, 
prove that there exist £2 > and C5 > such that, for every y G L 2 (0,L) 
and for every y 1 G L 2 (0,L) such that 

\\y°h'(p,L) + \\y 1 \\L*(o,L) ^ £2, 

there exists u G L 2 (0,T) satisfying 



such that the Cauchy problem (4-2T)-(4-28)-(4-29) has a unique solution y 
and this solution satisfies y{T, ■) = y . 
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Let us end this section by mentioning the following references where one can find 
other results on the controllability of nonlinear Korteweg-de Vries control systems: 

- [136] by Emmanuelle Crepeau, 

- J407] Ii08t lilOt 1411] by Lionel Rosier, 

- |428] by David Russell and Bing-Yu Zhang, 

- [513] by Bing-Yu Zhang. 

In each of these papers, the authors get local controllability results from the con- 
trollability of the linearized control system around the considered equilibrium using 
similar fixed-point methods. 

4.2. The linear test: The case of loss of derivatives 

Unfortunately the iterative method presented above needs to be modified for 
many partial differential control systems. We study in this section two examples: 



The first one on hyperbolic systems (Section 4.2.11 



The second one on Schrodinger equations (Section 4.2.2) 



4.2.1. Loss of derivatives and hyperbolic systems. In order to present 
the problem of loss of derivatives, we start with a very simple nonlinear transport 
equation 



(4.30) 


Vt + a(y)y x = 0, x G [0,L],te [0,T] 


(4.31) 


y{t,0)=u{t),te [0,21, 


where a G C 2 (K 


I) satisfies 



(4.32) o(0) > 0. 

For this control system, at time t G [0,T], the state is y(t, ■) G C 1 ([0,L]) and the 
control is u(t) G R. We could also work with suitable Sobolev spaces (for example 
y(t, ■) G H 2 (0, L) is a suitable space). We are interested in the local controllability 



of the control system (4.30)-(4.31 ) at the equilibrium (y,u) = (0,0). Hence we first 
look at the linearized control system at the equilibrium (y, u) = (0,0). This linear 
control system is the following one: 

(4.33) y t + a {0)y x = 0,te [0,T\, x € [0,L], 

(4.34) y(t,0) = u(t),t€[0,T\. 

For this linear control system, at time t G [0,T], the state is y(t, ■) G C 1 ([0,L]) and 
the control is u(t) G R. Concerning the well-posedness of the Cauchy problem of 
this linear control system, following the explicit method detailed on page [27] and 
the uniqueness statement of Theorem |2 ,4| on page |27| one easily gets the following 
proposition. 

Proposition 4.5. Let T > 0. Let y° e C^fltyL]) and u G ^([O,^) be such 
that the following compatibility conditions hold 

(4.35) u(0) = y°(0), 

(4.36) u(0) + o(0)j/°(0)=0. 
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Then the Cauchy problem 

(4.37) ifc + a(0)jfe = 0, t € [0,T},xe [0,L], 

(4.38) y(t,0) = u(t),te[0,T], 

(4.39) y(0,x) = y°(x),x£[0,L], 

has a unique solution y £ C 1 ([0,T] x [0,L]). 



Of course (4.35 I is a consequence of (4.381 and ( |4.39 l: it is a necessary condition 
for the existence of a solution y £ C°([0, T] x [0, L\) to the Cauchy problem ( 4.37[ 
(|4.38|-(|4.39|. Similarly (|4.36|) is a direct consequence of (|4.37|), (|4.38[) and (4.39 



it is a necessary condition for the existence of a solution y £ C^QOjT] x [0, L]) to 
the Cauchy problem (|4.37|-(|4.38|-(|4.39|). 



Adapting the explicit strategy detailed in Section |2.1.2.1| one easily gets the 
following proposition. 



PROPOSITION 4.6. Let T > L/a(0). The linear control system (4.33)-(4.34) 



is controllable in time T. In other words, for every y° £ C 1 ([0, L]) and for every 
y 1 £ £^([0, L\), there exists u £ (^([OjT]) such that the solution y of the Cauchy 



problem (4.31)-(4.38)-(4.39) satisfies 

(4.40) y(T,x) = y 1 (x),xe[0,L}. 

It is interesting to give an example of such a u. Let u £ C 1 ([0, T]) be such that 

(4.41) u(t) = y 1 (a(0)(T-t)), for every t £ [T - (L/a(0)),T\, 

(4.42) u(0) = j/°(0), 

(4.43) u(0) = -a(0)i£(0). 

Such a u exists since T > L/a(0). Then the solution y of the Cauchy problem 



fl4.37p - fl4.38H4.39p is S iven h y 

y°{x - o(0)t), V(i, x) £ [0, T] x [0, L] such that a(0)i < x, 



(4.44) 
(4.45) 



j/(t,x) 

y(t,x) = u(t- (sc/a(0))), V(i,x) £ [0,T] x [0,L] such that o(0)t > a;. 



(The fact that such a y is in C 1 ([0,T] x [0,L]) follows from the fact that y and u 
are of class C 1 and from the compatibility conditions (4.42 1-( 4.43 1.) From (4.441, 



one has (4.391. From T > L/a(0), (4.411 and (4.44 1, one gets (4.401. With this 



method, one can easily construct a continuous linear map 

T: ^([O.L]) -> {m£C 1 ([0,T]),u(0)=m(0) = 0} 
y 1 i— > m 

such that the solution y £ C 1 ([0, T] x [0, L]) of the Cauchy problem 

yt + a(0)y x = 0, (t.a;) £ [0,T] x [0,L], 

y(t,0) = «(t),ie [0,T], 

y(0,x)=0 7 xe [0,L], 



satisfies 



y(T, a; ) = y 1 ( a :),a:£ [0,L]. 



In order to prove the local controllability of the control system (4.30)-(4.31 ) at the 



equilibrium (y, u) = (0, 0), let us try to mimic what we have done for the nonlinear 
KdV equation (4.1|-(4.2| to prove the local controllability around (y,u) = (0,0) 
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(see Theorem 4.3 
u:(0,T)- 



on page 



161). Let y be the linear map which associates to 
' which is the solution of 



J the function y : (0, T) x (0, L) - 

yt + a(0)y x = 0, (t,x) € (0,T) x (0,L), 

j/(t,0)=u(t),te(0,r), 
v(0,a;)=0 > *G(0,£). 

Let S be the linear map which to y : (0, L) — > K associates the function y which 
is the solution of 

2/4 + o(0)y x = 0, (t,x)€ (0,T)x (0,1,), 

y(t,0) = 0,t€(0,r), 

2/(0,z)=y (z),ze(0,L). 

Let \P be the linear map which associates to / : (0, T) x (0, L) 
y : (0, T) x (0, L) -> R which is the solution of 

(4.46) yt + a(0)y x = /, (t, x) G (0, T) x (0, L), 

(4.47) y(t,0) = 0,t€(0,T), 

(4.48) i/(0,i) = 0,ie(0,L). 



the function 



Finally, let # be the nonlinear map which to y : (0,T) x (0,L) 
function z : (0,T) x (0,L) -» K defined by 



associates the 



(4.49) z := Sy + y o T( 2/ 1 - Sy°(T, ■) + (*((o(y) - o(0))y B ))(T, •)) 

- *((o(i/) - o(0))y B ). 

Then, up to regularity problems, a fixed point of 5 is a solution to our controllability 
problem. But the problem is now to find the good spaces in order to have a 
well defined continuous map 5- In order to avoid small technicalities coming from 
compatibility conditions, let us restrict to the case where 

(4.50) y°(0) = y° x (0) = 0. 

Concerning y, the natural choice of spaces is 

{ueC 1 ([0,T});u(0) = u(0)=0} -* C\[0,T] x [0,L]) 
u t-+ y 

with the usual topologies. Concerning S, the natural choice of spaces is 

{y° e C l ([0, L]); y°(0) = y° x (0) = 0} -> ^([0, T] x [0, L}) 

y° ^ y. 

But a problem appears now with \p. Indeed, for y € C 1 ([0, 7 1 ] x [0, L]) with y(0,0) = 
2/a:(0, 0) = 0, (a(y) — a(0))j/a; is expected to be only continuous (and vanishing at 
(i,x) = (0,0)). So we would like to have 

*: {/eC°([0,T]x[0,I]);/(0,0) = 0)} - C\[0,T\ X [0,L]) 

f >->■ y- 

But this does not hold. Indeed, let y be the solution of the Cauchy problem (in 



any reasonable sense) ( 4.46 1-( 4.47 1-( 4.48 1. From (4.46), one gets 



d/ 



y(t, a(0)t + x) = f(t, a(0)t + x), 
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which, together with (|4.47| and ( |4.48[ ), leads to 

y(t,x) - 



(4.51) 
(4.52) 



y(t,x) 



a{0){t - T))dr, if a(0)t> a;, 
o(0)(t -r))dr, if o(0)t < x. 



/(-r,a; 

-W«(o)) 

/o 

But, there are plenty of / G C°([0,T] x [0,L]), even vanishing at (0,0), such that 
y, defined by (4.51 1-(4.52 1, is not in C 1 ([0, T] x [0, L\). Note that y is continuous: 
we have "lost one derivative" . This problem of loss of derivatives appears in many 
situations. 

There is a general tool, namely the Nash-Moser method, that we will briefly de- 



scribe in the next section (Section 4.2.2 1, which allows us to deal with this problem 



of loss of derivatives. There are many forms of this method. Let us mention, in par- 
ticular, the ones given by Mikhael Gromov in [206, Section 2.3.2], Lars Hormander 
in [236J, Richard Hamilton in |216j : see also the book by Serge Alinhac and Patrick 
Gerard |10j . This approach can also be used in our context, but: 

1. It does not give the optimal functional spaces for the state and the control. 

2. It is more complicated to apply than the method we want to present here. 
The method we want to present here is the one which is used to construct solutions 
to the Cauchy problem 

(4.53) y t + a{y)y x = 0, t G [0,T],zG [0,L], 

(4.54) y(t,0)=u(t),te[0,T\, 

(4.55) i/(0,a:) = y (3;),:ce[0,L], 

and to more general hyperbolic systems (see e.g. [681 pages 67-70], [1341 pages 
476-478], [2381 pages 54-55], [321*1 pages 96-107], \M0\ pages 35-43] or [4431 



pages 106-116]). Concerning the Cauchy problem (4.53 l-(4.54 l-(4.55 I, one has the 
following theorem (see, for a much more general result, [321, Chapter 4]). 

Theorem 4.7. Let T > 0. There exist e > and C > such that, for every 
y° G C 1 ([0,L]) and for every u G C 1 ([0,T]) satisfying the compatibility conditions 



(4-35)-(4-36) and such that 

ll2/°llci([o,L]) + IMIcM[o,T]) ^ e, 



the Cauchy problem, (4-53)-(4-54 )-(4-55) has one and only one solution in C 1 ([0, T] x 



[0, L\). Moreover, this solution y satisfies 

(4.56) \\y\\cH[o,T]x[o.L]) < C (\\y°\\cH[o,L)) + \\u\\cH[o,T]))- 

The uniqueness part can be proved by using Gronwall's inequality. This is in 
the existence part that one uses the iterative scheme that we are now going to detail 
in order to prove the following controllability result. 



Theorem 4. 

(4.57) 



Let us assume that 
T> 



o(0)' 



Then there exist e > and C > such that, for every y° G C 1 ([0,L]) and for every 
y 1 G C x ([0,L]) such that 

\\y°\\cmo,L]) < £ and \\y 1 \\c^([o,L]) < £. 
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there exists u G C 1 ([0,T]) such that 

(4-58) IMIcM[o,T]) < C(\\y Q \\ CH%L]) + ||y 1 ||ci([o,L])) 

and such that the solution of the Cauchy problem (4-53)-(4-54)-(4-55) exists, is of 
class C 1 on [0,T] x [0,L] and satisfies 

y(T,x)=y 1 (x),x€ [0,L]. 

One can find similar results for much more general hyperbolic systems in the 
papers [95J by Marco China, [322] by Ta-tsien Li and Bing-Yu Zhang, and [319J by 
Ta-tsien Li and Bo- Peng Rao. In fact, these papers use a method which is different 
from the one we present now. We sketch below (see page 173) the method used in 
these papers in the framework of our simple transport equation. 

Our method to prove Theorem 4.8 is the following one. For y G C 1 ([0,T] x 
[0,L]), we consider the following lin ear control system 

(4.59) z t + a{y)z x = 0, (t,x) € [0,T] x [0,L], 

(4.60) z(t,0)=u(t),te[0,T], 

where, at time t, the state is z(t, •) G C 1 ([0, L\) and the control is u(t) G K. For 
every function / : K — * K, where K is a compact subset of R™, and for every p ^ 0, 
let 

«„(/) := Max{|/(6) - /(6)|; (6,6) G K 2 and |£ 2 - 6K p}- 
For e > 0, let W e be the set of (y°,y\b) G C^QO, L\) x C^O, L\) x C^QO, T] x [0, L]) 
such that 

ll2/°llc 1 ([o,L]) + ||2/ 1 ||c'i([0,£]) < e and ||6- a(0)|| C i([0,T]x[o,z,]) < £• 

The set W e is equipped with the usual topology of C 1 ([0, L]) xC x ([0, L]) xC^O, T]x 
[0,L]). Let us admit, for the moment, that one has the following controllability 
result. 

Proposition 4.9. Let T > L/a(0). There exist e > 0, C ^ 1 and a contin- 
uous map Z , 

W £o - C\[0,T]x[0,L]) 
{y°,y\b) h-» z = Z(y°,y\b), 

such that, for every (y ,?/ 1 ,^) G W eo , z satisfies 

(4.61) z t + bz x = 0,te[0,T\,xe[0,L], 

(4.62) z(0,x) = y°(x), z(T,x) = y\x), x G [0,L], 

(4.63) IMIcM[o,t]x[o,l]) < O (\\y°\\ C i ([0tL]) + \\y 1 \\c^{[o,L])), 



(4.64) uj p (z t ) + uj p {z x ) ^C (u p (y x ) + Lu p (yl)) + C (p + LU p (b x )+uj p (b t )) 

x (||y°||cM[o,i]) + IblcMlo.L])), Vp G [0, +oo). 
For e > 0, let 

B £ := {y G ^([O.T] x [0,L]); ||j/|| C i ([ o,T]x[0,i]) < e}, 
which is equipped with the topology defined by the norm || ■ ||c 1 ([q 1 t]x[o,£]) on 
C 1 ([0,T] x [0,L]). Let us now consider the following map JJ defined on B e , for 
£ > and ||j/°||c 1 ([o,L]) + H^Hc^p.L]) small enough, by the formula 

%{y):=Z{ y °, y \a{y)). 
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By Proposition 4.9 there exists e\ G (0,£o] such that, for e := E\, 3 is well defined 
and continuous if ||y°||ci([o,i]) + ll^llcHlo.i]) ^ e i- Then, by ( |4.63| , if 



\\y°\\cmo,L]) + \\y l \\cmo,L]) ^ pf (< £ u 



(4.65) 

we have 

(4.66) %(B ei )cB El . 

Since a is assumed to be of class C 2 on R, there exists Cj > such that 

(4.67) u p {a(y) x ) + w p (a(y) t ) < G 1 {u p {y x ) + u> p (y t )), Vy e B ei , Vp e [0, +oo). 



By (4.64 1 and (4.67l, we have, with z = 3(y) and y £ B £ 



(4.68) Wp (zt) + Up(**) < <?oMy£) + «p(»i)) 

+ C (p + C-i.w p {y x ) + Ciw p (2/t))(ll2/°llc 1 ([o,L]) + ll^llcHlo.i]))- 
Let 57 : [0, +oo) — > [0, +00) be defined by 

(4.69) J2(p) := 2C7 (a;p(i/2) + v P (vl)) + 2p. 

Let 

(4.70) K := {y € B eo ; u p (y x ) + Up(y t ) ^ £l(p),Vp € [0,+oo)}. 

By Ascoli's theorem (see, for example, |419l A 5 Ascoli's theorem, page 369]), K is 



a compact subset of B ea . Clearly K is convex. Moreover, by (4.66), (4.681, (4.69) 
and (14.70b, if 



(4.71) 
then 



\\y°\\cH[o,L]) + lls/ 1 ||c 1 ([o,x,]) < MiiJex 



S(*0 C A', 



1 



Co(l + 2C 1 )'2C C 1 



which, together with the Schauder fixed-point theorem (Theorem B.19 
implies that 5" has a fixed point. But, if y is a fixed point, then 

vt + a{y)vx = o, t e [o,T},xe [o,l], 

y(0,x)=y°(x),xe[0,L}, 
y{T,x) = y 1 {x),xe [0,L], 



on page 



3921 



Hence the control u(t) := y(t,0) steers the control system (4.30 1-( 4.31 1 from the 
state y° to the state y 1 during the time interval [0,T]. Inequality (4.58) follows 



from (4.63 I. This concludes the proof of Theorem 4.7 assuming Proposition 4.9 



Proof of Proposition |4.9[ Let 

$ : (h,t 2 ,x) e £>(*) C [0,T] x [0,31 X M ^ ®(h,t 2 ,x) G [0,L] 
be the flow associated to the ordinary differential equation £ = bit, £): 



<5/i 



6(ti,*),tie [0,T], 



®(t 2 ,t 2 ,x) = x,t 2 e [o,T], xe [o,L]. 
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From now on, we assume that (j/ ,?/ 1 ,^) G W £ . For every (t2,x) G [0,T] x [0,L], 
#(-,t2,x) is defined on some closed interval [t_(£ 2 , x), T + (t2, x)] C [0,T] containing 
£2 • At least for e > small enough (which will always be assumed) , we have, using 



(4.571, 



Let 



b(t,x) > 0, V(£,x) G [0,T] x [0,L], 

$(t_(T,L),T,L) = 0, t_(T,L)>0, 

$(r+(0,0),0,0)=L, r + (0,0)<T. 

Q := {(i,x) e [0,21 x [0,L]; 9(t,T,L) <x< $(£,0,0)}. 



(See Figure nl) 



r+(0,0) 




Figure 1. Flow $, Q, T-(T,L), r+(0,0) 



We first define z on the set ([0, T] x [0,L])\Q by 

(4.72) z(t, x) := y x {^{T, t, x)), V(£, x) G [0, T] x [0, L] such that x < $(£, T, L), 

(4.73) «(t, x) := y°($(0, £, x)), V(£, x) G [0, T] x [0, L] such that x > $(£, 0, 0). 
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For ie {1,2,3,4}, let a, G C 2 ([0,1]) be such that 

Oi(0) = 1, 4(0) = 0, oi(l) = 0, ai(l) = 0, 
a 2 (0) = 0, a' 2 (0) = 1, a 2 (l) = 0, 4(1) = 0, 
a 3 (0) = 0, 4(0) = 0, o 3 (l) = 1, 4(1) = 0, 
a 4 (0) = 0, 4(0) = 0, o 4 (l) = 0, 4(1) = 1. 
Let u : [0,t_(T,L)] -» K be defined by 

N 6(0, 0)i£(0)r_(T, £)<*;/ 



'"^ := ^ ai Vr_(r,i, 

+ z(r„(T,L),0)a 3 



r_(T,L) 

+ z t (T_(T, J L),0)r_(T,L)a 4 



£ 



r-(r,L) 



,t_(T,L), 

where 2 t (r_(T', L), 0) is the left derivative with respect to time at time T—(T, L) of 
z(-,0) G ^([^(T.L),^); see ( |4.72| ). Finally we define 

(4.74) z(t,a:) := u(r_(t,cc)), V(t,a;) G Q. 

Then, after some rather lengthy but straightforward computations one can check 



that the function z defined by (4.721, (4.73) and (4.74 1 satisfies all the required 



properties if e > is small enough. This concludes the proof of Proposition [OJ] and 
also of Theorem 14.81 ■ 



Remark 4.10. As for the Nash-Moser method, the controllability of the lin- 
earized control system ( 4.37 )-( 4.38 )-( 4.39 1 at the equilibrium {y e ,u e ) := (0,0) (see 

one 



Proposition 4.6 



on page 



166) is not sufficient for our proof of Theorem 4.8 



needs a controllability result (see Proposition 4.9 on page 169 I for linear control 



systems which are close to the linear control system (4.37l-(4.38 1-(4.39 I . For some 
other hyperbolic control systems (see for example page 214 and the proof of Propo- 
sition 6.29 given in [116]) we have not been able to check that every linear control 



system close to the linearized control system at the equilibrium considered are con- 
trollable, but we can do it for a large enough family of these linearized control 
systems. Then one can again get the controllability by a fixed-point method such 
that the image of the map 5" lies in a suitable family. Note that the control offers 



some flexibility: we can require, beside (4.61 1 to (4.63), some extra conditions 



Remark 4.11. Even if (y,y(-,0)) is a trajectory of the control system (4.53) 



(4.54 1, the linear control system ( 4.59 l-( 4.60 ) is not the linearized control system 



around this trajectory. Indeed this linearized control system is 

(4.75) zt + a{y)z x + a'{y)zy x = 0, (t, x) G [0, T] x [0, L], 

(4.76) z(t,0)=u(t),te[0,T], 

where, at time t, the state is z(t, ■) G C 1 ([0, L\) and the state is u(t) G 

that one encounters the problem of loss of derivatives if one uses the linear control 

system (|4.75|-(4.76l, together with the usual Newton iterative scheme; see also 



Note 



Remark |6.1| on page |189| as well as Remark |6.30| on page |214| 

Remark 4.12. Our proof of Theorem |4.8| on page |168"| does not use the existence 



part of Theorem 4.7 



on page 



168 on the solutions to the Cauchy problem (4.53) 



(4.54 1-(4.55 I : our method directly proves the existence of a solution. (This is 
also the case for many other control problems. This is for example the case for 



4.2. THE LINEAR TEST: THE CASE OF LOSS OF DERIVATIVES 



173 



the Euler equations of incompressible fluids; see Section 6.2.1 ) However, as we 



mentioned on page |168| the fixed-point method used here is in fact strongly related 
to the classical method used to prove the existence of a solution to the Cauchy 
problem (4.53 1-(4.54 1-(4.55 I (or more general hyperbolic systems). Our fixed-point 



approach is, in particular, very close to the one introduced by Ta-tsien Li and Wen 
Ci Yu in [321, pages 96-107]. As in 321, pages 96-107], we get the existence of a 



fixed point of $ by establishing estimates on the modulus of continuity (see (4.68)). 
With some extra estimates, one can use the Banach fixed-point theorem instead 
of the Schauder fixed-point theorem. Note that the Banach fixed-point theorem 
is more convenient than the Schauder fixed-point theorem for numerical purposes; 
see also [Ml pages 67-70], [i"34l pages 476-478], [2381 pages 54-55], |3J0[ pages 
35-43] or [443, pages 106-116] for the existence of solutions to the Cauchy problem 



(4.53l-(4.54|-(4.55l 



Finally, let us briefly sketch the alternative method to prove controllability re- 
sults for hyperbolic systems used by Marco China in [95] and by Ta-tsien Li and Bo- 
Peng Rao in [319] . For simplicity we present it again on our simple nonlinear trans- 
port equation (4.30 l-(4.31 1 , that is, we show how their method to prove Theorem 
4.8 works. For y G C ,1 ([0, T] x [0, L]), let us denote by & y the flow associated to the 
differential equation £ = <z(y(£, £)) ( see P a S e 1701. For every (t2,x) G [0,T] x [0,L], 
<$>(■, t2,x) is defined on some closed interval [T y -(t2,x),T y+ (t2,x)] C [0, T] contain- 
ing t2- Let also Q y be the set of (t,x) G [0,T] x [0,L] such that 

x < ® y (t,T,L) or x > $3,0,0,0). 

The first step is the proof of the following proposition. 



Proposition 4.13. Let us assume that (4-57y holds. Then there exist e > 
and C > such that, for every y° G C ([0,L 
that 



) and for every y 1 G C ([0,L]) such 



l|y°llci([o,L]) < £ and H^HcHlo.i]) < e -, 
there exists z G C ([0,T] x [0,L]) such that 



(4.77) 
(4.78) 
(4.79) 
(4.80) 
(4.81) 
(4.82) 
(4.83) 



a{z{t,x)) > 0, V(t,x) G [0,T] x [0,X], 

t z _(T,L) >0, *,(0,T,L) = 0, 

$ z (r z+ (0,0),0,0) = L, r z+ (0,0)<T, 

Zt + a(z)z x = in Q z , 

z(p,x) = y°(x),Vxe[0,L], 

z{T,x) = y 1 {x),\/xe [0,L], 

\\4cm0,T]x[0,L]) ^ C (\\y°\\cH[0,L]) + IblcMIO.L]))- 



The proof of this proposition is now classical; see [3211 Chapter 4] by Ta-tsien 
Li and Wen Ci Yu for much more general results on hyperbolic systems. As we 
mention in Remark |4.12| on the preceding page, it can be obtained by the fixed- 
point strategy we have used above to prove Theorem |4.8| on page |168[ We omit 
it. 
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Now let u G C x ([0, T]) be such that 

u(i)=*(i,0),Vt€ [r 2 _(T,L),T], 

u(0) = y°(0), 

u(0) = -o(y°(0))yS(0). 

We can also impose on u that, for some C\ > independent of y° and y , provided 
that HylcMlo.L]) + ||y 1 ||ci([o,L]) is small enough, 



(4.84) 



ll«llcM[o,T]) < Ci(lkO,0)|| C i ([ o,T]) + l|j/°llci([o,i])) 



By (4.83), (4.841 and Theorem 



4.7 



168 



if l|y°llcH[o,L]) + H^llcHIo.i]) 



on page 

small enough, there exists (a unique) y G C 1 ([0,T] x [0,L]) solution to the Cauchy 
problem 

Vt + a{y)y x = 0, t e [0,T], x e [0,L], 

y{t,0)=u{t),te [0,31, 

y(0,x) = y°(x),xS[0,L]. 

Then one checks that Q y = Q z and that y = z on Q y . In particular, 
y(T,x) = z(T,x)=y 1 (x),Vx€ [0,L\. 



of this alternative proof of Theorem 4 



Inequality (4.581 follows from (4.56), (4.831 and (4.84l. This concludes the sketch 



Remark 4.14. This method is simpler than our first proof of Theorem 4.8 (see 
pages 168|172 ). However, in some cases, the alternative method does not seem 
to apply whereas the first one can be used; see, for example, Proposition 6.29 on 
page |214| 



4.2.2. Loss of derivatives and a Schrodinger equation. In this section 
we consider a nonlinear control system where the problem of loss of derivatives 
appears and where the trick used above in Section |4.2.1| to handle this problem 
does not seem to be applicable. Let I = ( — 1, 1) and let T > 0. We consider the 
Schrodinger control system 

(4.85) i/) t (t, x) = iil) xx (t, x) + iu(t)xip(t, x), (t, x) e (0, T) x /, 

(4.86) V(*,-l) = ^(*,l)=0 ) te(0 ) T). 

This is a control system, where, at time t G (0, T): 

- The state is tp(t,-) € L 2 (I;C) with fj \ip(t, x)\ 2 dx = 1. 

- The control is u(t) G R. 

This system has been introduced by Pierre Rouchon in [41 7| . It models a non- 
relativistic charged particle in a 1-D moving infinite square potential well. At time 
t, if){t, ■) is the wave function of the particle in a frame attached to the potential 
well. The control u{t) is the acceleration of the potential well at time t. We use 



the notations introduced in Section 2.6 Note that, with ^ 7 defined in (2.4941, we 
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have 



tpi n t = i4>i, T xx + i"/xipi n , t G (0, T), x G I, 
^ 1)7 (t, -1) = Vi, T (t, 1) = 0, t € (0,T), 

|V>i, 7 (i,z)| 2 cfe = 1, £G (0,T). 



Hence (^i, 7 ,7) is a trajectory of the control system (4.85 )-(4.86). We are interested 
in the local controllability around this trajectory. The linearized control system 
around this trajectory is the control system 



(4.87) 
(4.88) 



ty t = i\fr xx + ijxty + iuxipi a , {t, x) G (0, T) x I, 
*(t l -l) = *(<,l)=0 l t€(0,T). 



It is a linear control system where, at time t € [0,T]: 

- The state is *(i, ■) e L 2 (I; C) with *(t, ■) G T s (V>i, 7 (£, ■))• 

- The control is u(t) G K. 

Let us recall that § is the unit sphere of L 2 (I; C) (see (2.490)) and that, for <fi G S, 
Ts((j>) is the tangent space to § at (see ( |2.491 1). We have studied the controllability 
of this linear control system in Section ]2.6| Theorem [2.87| tells us that this linear 
control system is controllable with state in H? Q s D T§('0i :7 (t, ■)) (Hf \ is defined in 
(2.499 1) and control u in L 2 (0, T) if 7 > is small enough (this controllability does 
not hold for 7 = 0; see page 97). This leads naturally to the following problem, 
which is still open. 

Open Problem 4.15. Let T > 0. Does there exist 70 > such that, for every 
7 G (0,70), there exists e > such that, for every ip° G H? JI;C) C\ T§(ipi^(0, ■)) 
and for every if) 1 G H? Q JI;C) f~l T§(ipi n (T, •)) such that 

U° - </>i, 7 (0, OllH»(/iC) + ll^ 1 - M?, 0IU»(/iC) < e, 

there exists u G L 2 (0, T) such that the solution 

i J eC Q ([0,T};H 3 (I;C)nH^I;C))nC l ([0,T};H l (I;C)) 

of the Cauchy problem 

(4.89) 
(4.90) 
(4.91) 



ipt(t, x) = iip xx (t, x) + iu(t)xip(t, x), (t, x) G (0, T) x I, 

V(*,-l) = V(*,1) = 0, tG(0,T), 

^(0,a;) = ip°(x), x€l, 



satisfies 



4>(T,x) = ip\x), xe 11 



(For the well-posedness of the Cauchy problem (4.89)-(4.90)-(4.91 ), we refer to 
|40|.) However, if one lets 



(4.92) Ff 0) (I; C) := y G H%I; C); pW(-l) = ^'(1) = 0, Vfc G {0, 1,2}}, 
one has the following theorem due to Karine Beauchard [401 Theorem 2]. 
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Theorem 4.16. Let T = 8/rr and let rj > 0. There exists e > such that, for 
every ip° G H b {Q) (I; C) H H 5 +^{I; C) l~l T s (^i, 7 (0, ■)) and for every tJj 1 G # ( 5 0) (/; C) H 
H 5+r >(I; C) n r s (^i, 7 (T, •)) such that 

\\ip° - t/>i,<y(0, -)IIh 5 +"(/;C) + IIV' 1 - i>i,-y( T > •) l|jy 5 +"(z ; c) ^ £j 
there exists u g i/g(0,T) smc/i i/iai i/ie solution 

V G C°([0, T]; tf 3 (/; C) n ^(J; C)) n C^QO, T]; if 1 !/; C)) 



of the Cauchy problem (4.89)-(4-90)-(4-91) satisfies 



i>(T,x) =ip\x), xE I. 

Remark 4.17. In [401 Theorem 2], ^° and ip 1 ar e assumed to be more regular 
than in H 5+v . However, Karine Beauchard has proposed in [4lj I42j a modification 



which allows us to handle the regularity stated in Theorem |4.16| 



The proof of Theorem |4.16| is quite long. Here, our goal is not to give it but only 
to explain the main difficulty (loss of derivatives) and the method used by Karine 
Beauchard to solve it. For simplicity, let us study only the case where i/j° — ^1,7 ■ 
Then the local controllability problem is to decide whether the map Q which, to a 
control u : [0, T] — > K, associates the state ip(T, ■) g §, where ip : (0, T) x / — > C is 
the solution of the Cauchy problem (4.89)-(4.90)-(4.91 ), is locally onto at the point 
u := 7 or not. The problem is that one does not know a couple of Hilbert spaces 
(H, H) (of infinite dimension) such that 

(4.93) G is of class C 1 , 

(4.94) g'(u) : H -> H f~l T s (^i i7 (T, •)) is onto. 

Let us recall that, ignoring this problem, we would get a control u steering our 
control system ( 4.85 )-( 4.86 1 from -0° = ^1,7 to ip l by showing that the sequence 

(4.95) u n+1 = u n - G'iuy^iGiu,, 



V 1 ) 



is convergent. In (4.95), Q'{u) denotes a right inverse of Q' (u) and P is the 
projection on the tangent space to § at ipiy. In Theorem 2.87 



on page 



9(i 



have constructed a right inverse ^'(m) _1 . But this right inverse sends elements of 
H k (I;C) to elements of H k ~ 3 (0,T) and, if u is in H k (0,T), one cannot expect 
G(u) to be more regular than H k+2 (I;C). So, if u n G H k (0,T), we expect u n+ i to 
be only in H k ~ 1 (0,T). (In fact the situation is even worse due to some boundary 
conditions which have to be handled.) So, at each step, we lose "one derivative". 
Therefore the sequence (M n )„ S N will stop after a finite number of steps, at least if 
u\ is not of class C°° (and is not expected to be convergent if u\ is of class C°°). 



In order to avoid this problem, one could try to modify (|4.95|) by putting 

, - s n g'{u)- x p{g{ur, 



(4.96) 



l n+l 



^) 



where S n is some "smoothing" operator such that, as n — > 00, S n — > Id, Id denoting 
the identity map. But it seems difficult to get the convergence of the u n 's with such 



an iterative scheme, because, in some sense, the convergence of (4.95 I, even without 



the loss of derivatives problem is too slow. One uses instead of (4.951, the Newton 
method, which ensures a much faster convergence, 

(4.97) u n+1 = u n - G'iu^PiGiun) - ^). 
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The Newton method modified to take care of the loss of derivatives problem, is 
(4.98) u n+1 = u n - S^'K^P^K) - ^)- 



The replacement of (4.97) by (4.981 is the key point of the Nash-Moser method. 



Now, with very careful (and lengthy) estimates and clever choices of S n , the se- 
quence (M„)ngN is converging to the desired control. 

Remark 4.18. As in the case of the problem of loss of derivatives we have 



seen for a simple hyperbolic equation (see Section 4.2.1 ), it is not sufficient to have 
the controllability of the linearized control system along the trajectory (^1^,7), 
but also the controllability of the linearized control systems around the trajectories 
which are close to the trajectory (V>i l7 ,7)- 



Remark 4.19. Karine Beauchard has shown in |41j that this Nash-Moser 
method can also be used to get various controllability results for a nonlinear one- 
dimensional beam equation. 

Remark 4.20. One can also adapt this Nash-Moser method to get the control- 
lability of the hyperbolic control system (4.30 1-(4.31 1. However, in terms of regu- 



larity of the couple state-control, one gets a slightly weaker result than Theorem 
4.8 Note that Serge Alinhac and Patrick Gerard have used in [10] the Nash-Moser 
method to study the Cauchy problem (4.53 l-(4.54 l-(4.55 I. 



Remark 4.21. The Nash-Moser method has been introduced by John Nash in 
|374j to prove that every Riemannian manifold can be isometrically embedded in 
some R fc (equipped with the usual metric). It has been developed subsequently by 
Jiirgen Moser in [3681, 13701 [369] , by Mikhael Gromov in [205] and [20B1 Section 
2.3], by Howard Jacobowitz in 249J, by Richard Hamilton in [216 and by Lars 
Hormander in 236], 1237] . Let us point out that Matthias Giinther has found in 
J212L [213, a way to prove the result on isometric embeddings by classical iterative 
schemes. It would be interesting to know if this is also possible for Theorem |4.16| 
on the previous page. 



4.3. Global controllability for perturbations of linear controllable 

systems 

When the nonlinearity is not too strong, one can get with suitable arguments 
global controllability results. 

In this section, we illustrate in a detailed way, on an example, a method due 
to Enrique Zuazua j5 151 1516] . which allows us to deal with such cases. For a 
description of this method in the framework of finite-dimensional control systems, 
see Section |3.5.1| We explain it on a simple 1-D semilinear wave equation with 
a boundary control and a nonlinearity which is at most linear (even if one can 
consider less restrictive growth at infinity as shown in [516]; see also Remark 4.23 
on page 
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The control system we consider is the following one: 



(4.99) 
(4.100) 



ytt -y xx + f{y) = 0, (t, x) e (0, T) x (0, L) , 
y(t,0)=0, y x (t,L)=u(t), te(0,T). 
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In this control system, the control at time t is u(t) G 1 
y(t, •) : (0, L) — > K. We assume that the function / : 
satisfies, for some (7 > 0, 



and the state at time t is 
X — y M. is of class C 1 and 



(4.101) 



1), Va g 



\f(s)\^C(\s\ 
As above (see Section 2.4), let 

i7 ( 1 0) (0,L):={aeff 1 (0,L);a(0) = 0}. 



Adapting the proof of Theorem |2.53| on page [68] and using classical arguments 
(see e.g. _84J) , it is not difficult to check that, for every T > 0, for every u € 
L 2 (0,T), and for every (a°,f3°) G H(n\ x L 2 (0,L), there exists a unique solution 
y G C°([0,T];H£(0,L)) n C^^T]; L 2 (0,L)) to the Cauchy problem 



(4.102) 
(4.103) 
(4.104) 



ytt-y x:c + f{y) = o, (t,x)e (0,T) x (0,L), 

y(*,0)=0, yi (t,L) = u(t),t€(0,T), 

j/(0,ic) = a°(cc) and j/ t (0,x) = /3°(x), a; G (0,L). 



The goal of this section is to prove the following theorem, which is due to Enrique 
Zuazua |516l Theorem 3 and Section 6]. 

Theorem 4.22. Let T > 2L > 0. For every a G HLJ0,L), for every (3° G 
L 2 (0,L), /or every a 1 G H} Q J0, L), and for every (3 1 G L 2 {0,L), there exists u G 



L 2 (0,T) smc/i i/jcrf f/ie solution y of the Cauchy problem (^ . i 02\ - \4 ■ 1 0ty - {4 ■ 1 04]) 
satisfies 

(y(T 7 -),y t (T r )) = (a\(3 1 ). 



Let T > 2L > 0. Let (a , a 1 ) G 71^(0, L) 2 and 

we are going to 



3.40 



on page 



151 



Proof of Theorem 4.22 

(J3°, P l ) G L 2 (0, L) 2 . As in the proof of Theorem 
get u as a fixed point of a map T . This map 

T: L°°((0,T)x(0,L)) -y L°°((0,T) X (0,L)) 



(4.105) 

is defined in the following way. Since / £ C 1 



(4.106) 



there exists a. G C ( 

/(y) = /(0)+«/(y),VyeR. 



such that 



Note that, by ((L101J, 

(4.107) geL°°(R). 

Let 77 G C 1 ([0,T];L 2 (0,L))nC°([0,T];i7 1 (0,L)) be the solution of 

(4.108) rut - Vxx + g(y)v + f(P) = 0, t G [0, T), x G [0, L], 

(4.109) r?(t, 0) = »fe(i, L) = 0, t G (0, T), 

(4.110) 77(0, &) = rit(0, x) = 0,xe (0, L). 

Let U be the set of u* G L 2 (0,T) such that the solution z* of the Cauchy problem 



(see Definition 2.52 



on page 



68 and Theorem 2.53 



on page 



681 



zn-zl x + g(y)z*=0,t€ [0,T], x€ [0,L], 

z*{t,0) = 0, z*(t,L) = u*(t), t G (0,T), 
z*(0,x) = a°(x), z*{0,x) = /3°(x), x G (0,L), 
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satisfies 



z*(T,x) = a\x) - T)(T,x), z* t (T,x) = (3\x) - r) t (T,x), x G (0,L). 

on page 



2.55 



72 



The set W is a closed affine subspace of L 2 (0,T). By Theorem 
U is not empty. Let u be the projection of on IA. In other words, u is the least 
L 2 (0,L)-norm element of U. Let z G ^([O, T]; L 2 (0, L)) n C°([0, T]; iJ^) be the 
solution of the Cauchy problem 

hi ~ z xx +g(y)z = 0, t G [0,T], cc € [0,L], 

i(t,o) = o,^(t J i) = «(t),<€(o,r), 

2(0, sc) = a°(x), z t (0,x) = 0°(x), x e (0,L). 

Then we let 

Z := r\ + z. 
Note that z G C 1 ([0, T]; L 2 (0, L)) n C°([0,T];iZ' r 1 o1 (0,X)) is the solution of the 
Cauchy problem 

(4.111) 
(4.112) 
(4.113) 
and satisfies 



W 



z« - ^ + 9{y)z + /(0) = 0, t G [0, T], x G [0, t], 

z(t,0) = 0,z x (i,L) = «(t),te(0,T), 

z(0,a;) = a°(x), «t(0,a;) = &°{x), x e (0,L), 

z(T,x) = a l (x), z t (T,x) = (3\x), x G (0,L). 



Hence it suffices to prove that T has a fixed point, which gives y = z in (4.1111 

")x(0,I 
on page 



It is not hard to check that T is a continuous map from L°°((0,T) x (0,L)) into 

Theorem 



L°°((0,r) x (0,L)). Using Theorem 2.53 



on page 



2.55 



72 and 



(4.1071, one gets the existence of M > such that 

(4.114) T(L°°((0,T)x(0,L)))cK, 

where K is the set ofze C x ([0, T]; L 2 (0, L)) fl C°([0, T]; ^(0, L)) such that 
||-«||c l ([0,T];i3(o,i)) < M, ||^||co([0,T];i3^- ,(0,i)) < A/ - 

Note that if is a convex subset of L°°((0, T) x (0, L)). Moreover, by a theorem due 
to Jacques Simon [449 , 

(4.115) K is a compact subset of L°°((0,T) x (0,L)). 

on page 



Hence, by the Schauder fixed-point theorem (Theorem B.19 



fixed point. This concludes the proof of Theorem |4.22| 



3921, T has a 



Remark 4.23. It is proved in [5 16) that the growth condition (4.1011 can be 
replaced by the weaker assumption 

1/001 



(4.116) 



lim sup g < °° ■ 

W-H-oo |s|ln (|s|) 



Note that (4.1161 is nearly optimal: Enrique Zuazua has proved ( 516, Theorem 
2]) that, if 



lim inf „ 

s->+oo \s\ lir (s / 



>0 
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for some p > 2, then there are a € H} Q J0,L), (3° £ L 2 (0,L), a 1 € H^(0,L) and 
/3 1 G i 2 (0, L) such that, for every T > and every u £ £ 2 (0, T), the solution y of the 
Cauchy problem (|4 102^-(|4103|-(|4.104|| does not satisfy (y(T, -),y t {T-)) = (a 1 ^ 1 ). 



Remark 4.24. Enrique Zuazua has proposed in |520j a numerical method 
based on this fixed-point method and a two-grid approximation scheme to get a 



control steering the control system (4.99 1-(4. 100) from a given state to another 
given state, as in Theorem |4 . 2 2 1 on page |178) The idea to use a two-grid method in 
the control framework in order to avoid spurious high frequencies interfering with 
the mesh is due to Roland Glowinski [201 . 

Remark 4.25. The above method has been used for many other partial differ- 
ential equations. In particular, for the controllability of semilinear heat equations, 
let us mention [156] by Caroline Fabre, Jean-Pierre Puel and Enrique Zuazua, [165 
by Luis Fernandez and Enrique Zuazua, [169 by Enrique Fernandez-Cara and En- 
rique Zuazua, [186, Chapter I, Section 3] by Andrei Fursikov and Oleg Imanuvilov, 
and }517l 1518] by Enrique Zuazua. 

Remark 4.26. In order to conclude by using the Schauder fixed-point theorem, 



one needs some compactness properties ((4.115) here). Irena Lasiecka and Roberto 
Triggiani have presented in [300J a method to conclude by using a global inversion 
theorem. This allows us to treat other semilinear control systems which cannot be 
handled by the Schauder fixed-point theorem. 



CHAPTER 5 



Iterated Lie brackets 



In this short chapter we start by explaining why iterated Lie brackets are less 
powerful in infinite dimension. Then we show on an example of how iterated Lie 
brackets can sometimes still be useful in infinite dimension. 

Let us go back to the simplest control partial differential equation we have been 
considering, namely the case of the transport equation (see Section 2.1 on page 
So our control system is 



24 1 



(5.1) 
(5.2) 



vt + Vx = o, x e [o,l], 

y(t,0)=u(t), 



where L > is fixed and where, at time t, the control is u(t) e R and the state 
is y(t, ■) : [0,L] — > R. Let us use the same control t i— > u(t) that we have used on 
page 131 to justify the interest of the Lie bracket [/o, /i] for the finite-dimensional 
control system x = fo(x) + ufi(x). (Let us recall that we have seen in Section 
2.3.3.1 how to write the control system (5.1)-(5.2) in the form y = Ay + Bu.) So, 



let us consider, for e > 0, the control defined on [0, 2e] by 



u(t) = -1 forte (0,e), 
u(t) = 1 for t e (e,2e). 

Let y : (0, 2e) x (0, L) — > R be the solution of the Cauchy problem 

y t + y x = 0,te (0,2e), xe (0,L), 

y(t l 0) = «(t),t€(0,2e), 

p(0,ar)=0,a;e(0,L). 

Then one readily gets, if 2e sj L, 

y(2e,x) =1, xe (0,e), 
y(2e,x) = -1, x e (e,2e), 
y(2e,x) = 0, xe (2e,i). 



Hence (compare with (3.25 l) 

y(2e,x) - y(0,x) 



(5.3) 



+cxd as £ — > 



L 2 (0,L) 
181 



182 



5. ITERATED LIE BRACKETS 



Note that, for every </> G H (0, L), 
/ <j>(x)(y(2s,x) -y{Q,x))dx = 



<fi(x)dx — I 4>(x)d3 
Jo 

((p(x + e) — <f>(x))dx 



o 



e fx+e 

<j)'(s)dsdx 
o Jx 

2 ^(o) + r f Vw - ^(s))d S dx. 

^0 Jx 



But we have, for every s G [0,2e], 

(5.4) |0'(*W(O)| = 

Hence 

(5.5) 



(j)"(T)dT 



< V2 £ ||</)"||l=(o,l). 



y(2e, •) - j/(0, •) 



^in(i7 2 (0,L))' 



as e — > oo, 



where <5q denotes the Dirac mass at 0. So in some sense we could say that, for the 



control system (5.1)-(5.2), [/o,/i] = ^o- Unfortunately it is not clear how to use 
this derivative of a Dirac mass at 0. 

However, there are cases where the iterated Lie brackets are (essentially) in good 
spaces and can indeed be used for studying the controllability of partial differential 
equations. This is, in particular, the case when there is no boundary. Let us give 
an example for the control of a quantum oscillator. This example is borrowed from 
Pierre Rouchon |415j and from Mazyar Mirrahimi and Pierre Rouchon [359]. We 
consider the following control system 



(5.6) 



^t = iipxx — ix ip + iuxif), t € (0, T), x G 



For this control system, the state at time t is i/j(t, •) G L 2 (K; C) with L \tp(t, x)\ 2 dx = 
1 and the control at time t is u(t) G K. The function ip(t, •) is the complex ampli- 
tude vector. The control u(t) G R is a classical control electro-magnetic field. The 
free Hamiltonian 

.Ho(V0 : = ~i>xx + x 2 ip 
corresponds to the usual harmonic oscillator. With our previous notations, we 
define the vector fields 



(5.7) 
(5.8) 



/o(V0 : = i^x 

/i(V>) := ixtp 



ix 2 ip, 



There is a little problem with the domain of definition of /o and /i : they are not 
defined on the whole S := {tfi G L 2 (R;C); J R \ip{t,x)\ 2 dx = 1}. But let us forge t 
about this problem and remain, for the moment, at a formal level. Using (3.191, 



(5.7) and (5.8 1, straightforward computations lead to 



[/o,[/o,/i]](V') = -4«^ = -4/ 1 (^), 
[/i,[/o,/i]]W>)=2#. 
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l.s:i 



Hence the Lie algebra generated by /q and /i is of dimension 4: it is the 
space generated by fo, f\, [/oi /i] an d iLd. Hence by Corollary 3.26 



linear 
on page 
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one would expect that the dimension of the space which can be reached from a 
given space should be of dimension at most 4. Since we are in infinite dimension 
and, more importantly, due to the fact that /o, /i, are not smooth and not even 
defined on all of S, one cannot apply directly Corollary |3.26| But let us check, by 
direct computations which are written- up in [415 and [359; (see, also, [78, pages 
51-52] and [39.) that the intuition given by the above arguments is indeed correct. 
For simplicity, we do not specify the regularity of u : [0, T] — > M, the regularity 
of ip : [0,T] x t -> C as well as its decay to as \x\ — > +oo: they are assumed 
to be good enough to perform the computations below. Let q : [0,T] — > R and 
p : [0, T] -> K be defined by 



q(t):= f x\iP(t,x)\'- 

Jm. 



dx, 



p(t) :- 



^s(ip x ip)dx, 



where 9(z) denotes the imaginary part of z € C Note that q(t) is the average 
position at time t and p(t) is the average momentum of the quantum system. The 
dynamics of the couple (p, q) is given by the Ehrenfest theorem (see, for example, 
[353, (I) page 182, vol. I]) 



(5.9) 



q = p,p 



-Aq + 2u. 



The linear system (5.9 I can be considered as a control system, where, at time t, the 
state is (p(t) , q(t)) tr , with p(t) € K and q(t) e K, and the control is u(t) G R. Note 



that, by the Kalman rank condition (Theorem 1.16 on pagepjj), the linear control 
system (5.9) is controllable. Following Anatoliy Butkovskiy and Yu. Samoilenko in 
[781 Page 51], let us define </> G C°([0,T];§) by 



(5.10) 
with 

(5.11) 



<p(t, x) := ip(t, x + q) exp(-ix(p/2) + ir), 



it) 



(q 2 (T)--p 2 (T)-u(T)q(r))dT. 



Then straightforward computations lead to 

(5.12) fa = i<p xx - ix 2 <j), t € (0,T), x € R. 

Note that the evolution of <j) does not depend on the control. With this precise 
description of ip, it is not hard to check that, given i/j° € §, the set 



{iP(T,-);T>0,u:(0,T) 



■ip is a solution of (5.6 1 such that ^(0 



^°} 



is contained in a submanifold of § of dimension 4; see also the following exercise. 
Exercise 5.1. Let us consider the control system 



(5.13) 



P, P 



-Aq + 2m, r 



tp - m, 



where the state is x := (q,p, r)* 



and the control is u G 



Check that this 



control system satisfies the Lie algebra rank condition at the equilibrium (x e ,u e ) := 
(0,0) g K 3 x K (see Definition 3.16 on page 134)- Prove that this control system 



INI 
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is not locally controllable at (x e ,u e ). (Hint. Use Theorem 3.36 on page 
k= I.) 

Let T > tt. Prove that, for every e > 0, there exists r\ > such that for every 
(q°,p°,r°) e K 3 and every (q l ,p l ,r l ) G K 3 with 

|3 |+|P°l + |r | + |g 1 |+|p 1 | + |r 1 |<T, > 

there exists u € L°°((0,T);M) with 

\u{t)\ ^e,t€(0,T), 



such that the solution of the Cauchy problem (5.13) with the initial condition 

(5.14) q(0)=q°,p(0)=p°, r(0)=r°, 

satisfies 

(5.15) q (T) = q\p{T)=p\r{T) = r 1 . 



(Hint. See Example 6.4 



on page 



190 ) 



Prove that the control system (5.13) is globally controllable in large time in 
the following sense: for every (q°,p u , r u ) £ K 3 and every (q ,p ,r ) G K 3 , there 
exist T > and u £ L°°((0,T);R) such that the solution of the Cauchy problem 
( f5J3| )- |5J^l ) satisfies (5J5| ). 



Remark 5.2. Let us consider the following modal approximation of the control 

iHoz — iuHiz, 

(± 

1 ... 





system (5.6 I 

(5.16) 

with 



H a 



§ 

§ 



\ 





\0 







2n+l 



ffl 



f° 


1 





1 





V2 





V2 



v/3 



\ 



73 



\0 



\/n+I 



y/n+1 




In (5.16), z £ S 2n +i ■= {z e C n+1 ; 



= 1}. Hongchen Fu, Sonia Schirmer and 
Allan Solomon have proved in [180j that, for every nGN, this modal approximation 
is globally controllable in large time: for every z° G §2n+i and for every z 1 € §2n+i> 
there exist T > and u € L°°(0, T) such that the solution of the Cauchy problem 



satisfies 



-iHoz — iuH\z, z(0) = z 



z(T) 
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This result shows that one has to be careful with finite-dimensional approximations 
in order to get controllability for infinite-dimensional control systems. 

Remark 5.3. Our application of iterated Lie brackets presented here (for the 



control system (5.6 1) was for a non-controllability result for partial differential equa- 
tions. There are applications of iterated Lie brackets to get (global) controllability 
results for a partial differential equation. Let us, for example, mention the control 
by means of low modes forcing for the Navier-Stokes equations and the Euler equa- 
tions of incompressible fluids obtained by Andrei Agrachev and Andrei Sarychev 
in |9_ and by Armen Shirikyan in |446j . 



CHAPTER 6 



Return method 



6.1. Description of the method 



The return method has been introduced in 103J for a stabilization problem, 

It has been used for the first time in [104L 1112] 



11.2.1 



that we detail in Section 

for the controllability of a partial differential equation (see Section 6.2.1 ) 



In order to explain this method, let us first consider the problem of local con- 
trollability of a control system in finite dimension. Thus we consider the control 
system 

x = f(x,u), 

where x G IK™ is the state and u £ K m is the control; we assume that / is of class 
C°° and satisfies 

/(0,0) = 0. 

Note that all the controllability conditions given in the previous chapter rely on a 
Lie bracket formulation. Unfortunately, this geometric tool does not seem to give 
good results for distributed control systems; in this case x belongs to an infinite- 
dimensional space. The main reason is that, for many interesting distributed control 



systems, (3.22) and (3.25) do not hold. More precisely, the left hand sides of (3.22) 
and (3.25) divided by e l have no limit as e — > in many interesting cases. See 
Chapter [5| for a very simple example. On the other hand, as we have already seen 
in Chapter [2] for linear distributed control systems, there are powerful methods to 
prove controllability. The return method consists of reducing the local controllabil- 
ity of a nonlinear control system to the existence of (suitable) periodic (or "almost 
periodic"; see below the cases of the Navier-Stokes control system, the shallow wa- 
ter equations and the Schrodinger equation) trajectories and to the controllability 

on page 



of linear systems (see also Remark 6.1 



189 1. The idea is the following one: 



Assume that, for every positive real number T and every positive real number e, 
there exists a measurable bounded function u : [0,T] — > K m with ||w||.z/*>(o,t) ^ £ 
such that, if we denote by x the (maximal) solution of x = f(x,u(t)), x(0) = 0, 
then 

(6.1) x(T) = 0, 

(6.2) the linearized control system around (x,u) is controllable on [0,T]. 



Then, from Theorem |3.6| on page |127| one gets the existence of r\ > such that, for 
every x° £ K n and for every x 1 € 1" such that 

\x°\ <n, ix 1 ] <n, 

there exists u G L°°((0, T); R m ) such that 

\u{t) -u{t)\ ^e,te [0,T] 

187 



INS 



6. RETURN METHOD 



and such that, if x : [0, T] — » R" is the solution of the Cauchy problem 

x = f{x,u{t)),x{0) = x°, 

then 

x(T) = a; 1 ; 
see Figure n\ Since T > and e > are arbitrary, one gets that x = f{x, u) 
is small-time locally controllable at the equilibrium (0,0) £ R n x R m . (For the 



definition of small-time local controllability, see Definition 3.2 on page 125 




Figure 1. Return method 



Let us recall (see Definition 3.5 



on page 



127) that the linearized control system 



around (x,u) is the time- varying control system 
(6.3) y = A(t)y + B(t)v, 

where the state is y € E™, the control is v G R m and 

A(t) := !£(S(t),u(i)), B(t) := ^(i(t),u(t)). 



Let us recall (Definition 1.2 on page HI) that, for the linear control system (6.3 1, 
controllability on [0, T] means that, for every yo and y\ in W l 1 there exists a bounded 
measurable function v : [0, T] —* R m such that if y = A(t)y + B(t)v and y(0) = ya, 
then y(T)=y 1 . 

on page 



Let us also recall (Theorem 1.18 
and if, for some t € [0,T], 

(6.4) Span {Bi(t)u; u E 



1 1 1 that if A and B are of class C° 



l ,ieN} 
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L,V) 



with Bi e C°°([T ,Ti]; £(R m ;R")) defined by induction on i by 
B (t) := B(t), Bi(t) := B^ x {t) - A{t)B^ x {t), 



then the linearized control system (6.3) is controllable on [0, T]. 

Note that if one takes u = 0, then the above method just gives the well-known 
fact that, if the time-invariant linear control system 



y 



9/ -(0,0)2/+^(0,0K 



dx du 

is controllable, then the nonlinear control system x = f(x, u) is small-time locally 

on page 128 1. However, it may happen that (6.2 1 does 
0, but holds for other choices of u. 



controllable (Theorem 3 
not hold for u 



Remark 6.1. In fact, for many nonlinear partial differential equations, one 
does not use the linearized control system along the trajectory (x, u) to get the 
local controllability result along (x, u). One uses other adapted methods. These 
methods can rely on the controllability of some linear control systems which are 
not the linearized control system along the trajectory (x,u) (see Remark 4.11 on 
page 172 as well as Remark 6.30 on page 214 1. It can also rely on some specific 



as well as itemark o.oU on page 
methods which do not use the controllability of any linear control system. This last 
case appears in the papers |239j by Thierry Horsin and [200 by Olivier Glass. 

Let us show on simple examples in finite dimension how the return method can 
be used. 



Example 6.2. 


We take n 


= 2, m = 


1 


on page 


144 


above) 


the control system, 




(6.5) 








Xi — x%, 


X-2 



1 and again consider (see Example 3.34 



u. 
For u = and x = 0, the linearized control system around (x,u) is 

Vi = 0, jfe = v, 

which is clearly not controllable (one cannot change y\). Let us now take T > 
and u G C°°([0,T];R) such that 

t-T/2 

u(t)dt = 0, 



u{T-t) = u(t), \/te [0,T]. 
Then one easily checks that 

x 2 (T/2) = 0, 

x 2 {T-t) = -x 2 {t),Vte [0,7], 

Xl (T -t) =x 1 {t), Vie [0,T]. 

In particular, we have 

Si(T)=0,S a (T) 

The linearized control system around (x,u) is 

Vl = 3xl{t)V2 , V2 

Hence 

'0 35 2 (i) 2 



0. 



A(t) 



i) 







,B{t) 



I'll) 
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and one easily sees that (6.4) holds if and only if 
(6.6) 3 i G N such that 



dl 



r(*)^°- 



Note that (6.6) holds for at least at in [0, T] if (and only if) u =£ 0. So (6.2) holds 
if (and only if) ti^O. We recover that the control system \6.5\ is small-time locally 
controllable at the equilibrium (0,0) e I 2 x M. 



Example 6.3. We return to the nonholonomic integrator (3.4-1) considered in 

3, m 



Example \3.20\ on page \135\ we take n 
(6.7) x 1 =u 1 , x 2 = u 2 , x 3 

where the state is x = {x\,X2,x^) tr G R' 



2 and the control system is 

= XiU 2 - X 2 Ui, 

and the control is u = (ui,u 2 ) tr 



Again one can check that the linearized control system around the trajectory (x, u) 
is controllable on [0, T] if and only if u ^ 0. 



Note that, for the control system (6.7), it is easy to achieve the "return condi- 



tion" (6.1). Indeed, let us impose that 

(6.8) u(T-t) = -«(*), V*e [0,T\. 
Then 

(6.9) x(T-t) = x(t),Vte[0,T\. 
Indeed, let y : [0, T] — > K 3 be defined by 

y(t)=x(T-t),Wte[0,T]. 
Then y, as x, satisfies the ordinary differential equation 

±1 = u\, x 2 = u 2 , £3 = XlU 2 - X 2 U\. 



Hence, since y and x are equal at the time T/2, y 
(6.9), we have 

x(T) = x(0) = 0. 



x, which gives (6.9). From 



So the control system (6.1) is again small-time locally controllable at the equilibrium 
(0,0) G K 3 x K 2 (a result which follows also directly from the Rashevski-Chow 



Theorem 3.19 



on page 



135) 



Example 6.4. We go back to the control system considered in Example \3.3£\ 
on page\148: the control system we consider is given by 



(6.10) 



X\ = x 2 , x 2 



-X\ + U, X3 = X4, £4 



-X3 + 2x\x 2 , 



where the state is {x\,x 2 ,xj,,x^) i 



and the control is u € 



One easily 



checks that this system satisfies the Lie algebra rank condition at the equilibrium 
(0, 0) e R 4 x R (Definition^ 



3.16 



on page 



134). In Example 



3.38 



on page 



148 



we saw 



that the control system (6.10) is not small-time locally controllable at the equilibrium 
(x e ,u e ) = (0,0) e R 4 x R. Here we want to see that the return method can be used 
to get large-time local controllability at the equilibrium (x e ,u e ) = (0,0) G R x R. 

Let us first give a new proof that this control system is not small-time locally 
controllable at the equilibrium (x e , u e ) = (0, 0) G R 4 x R. Indeed, if (x, u) : [0, T] — > 
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xKisfl trajectory of the control system (6.10) such that x(0) = 0, then 



(6.11) 
(6.12) 



x 3 (T)= x\(t) cos(T - t)dt, 
Jo 

„2/ 



x A {T) = x{{T) 



/ x\{t)sm(T -t)dt. 
Jo 



In particular, if Xi(T) = and T ^ tt, then x^(T) ^ with equality if and only if 
x = 0. So, if for T > we denote by V(T) the following controllability property 

V{T) There exists e > such that, for every x° € R and for every x 1 G K 4 
both of norm less than e, there exists a bounded measurable function u : 
[0,T] — > M such that, if x is the (maximal) solution of (6.10) which satisfies 
x(0) = x° , then x(T) = x , 

then, for every T € (0,7r], V(T) is false. 

Let us show how the return method can be used to prove that 



(6.13) 

Let T > 7T. Let 

Let xx : [0,T] -» 

(6.14) 

(6.15) 

Let x 2 : [0,T] -4 

In particular, 

(6.16) 
(6.17) 

Letx 3 : [0,T] -> 

(6.18) 

(6.19) 



V(T) holds for every T S (ir, +oo). 

rj = -Min {T — tt, it}. 
be a function of class C°° such that 

si(t) = 0,Vte [ri,Tr}U[Tr + r,,T], 

x 1 {t + Tr) = x 1 {t),\/te [0,rj\. 

and u : [0, T] — > K be such that 

x 2 ■= xi, u := x 2 + x\. 

Jc 2 (t) = 0,V<€ [^TrJUlTT + ^T], 
i 2 (* + 7r) = a;2(*), Vie [0,r?]. 

and X4 : [0, T] — > K &e defined by 

X 3 = Xi, X~4 = -x 3 + 2x\Xi, 

x 3 (0) = 0, Xi (0) = 0. 



So (x,u) is a trajectory of the control system (6.10). Then, using (6.11), (6.12) 
(6.14), (6.16), (6.15), (6.11), one sees that 



x{T) = 0. 

If xi = 0, (x,u) = and then the linearized control system around (x,u) is not 
controllable. However, as one easily checks by using the Kalman-type sufficient 
condition for the controllability of linear time-varying control system given in The- 
if X\ 7^ 0, then the linearized control system around (x,u) is 



1.18 



on page 



11 



controllable. This establishes (6.13) 



One may wonder if the local controllability of x = f(x, u) implies the existence 
of u in C°°([0,T];K m ) such that K\\ and d^2l hold. This is indeed the case, as 



proved by Eduardo Sontag in [452] . Let us also remark that the above examples 



1'I2 
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suggest that, for many choices of u, (6.2 I holds. This in fact holds in general. More 
precisely, let us assume that 



(6.20) 



/mi));/, ■£ Lu <j|^(-,0), aeN r ' 



where Lie T denotes the Lie algebra generated by the vector fields in T (see Defi- 
nition [3l3] on pagep3|. Then, for generic u in C°°([0,T];R m ), (^ holds. This 
is proved in |106j . and in |456j if / is analytic. Let us recall that by Theorem 3.17 



on page 134 (6.201 is a necessary condition for small-time local controllability at 
the equilibrium (0,0) G K™ x K m if / is analytic. 

Note that the controllability results obtained in Example |6.2| and Example |6.3| 
by means of the return method can also be obtained by already known results: 

- The small-time local controllability in Example |6.2| on page |189| follows 
from the Hermes condition (see page 143 and Theorem 3.29 on page 143) 
[22811469] , 

- The small-time local controllability in Example |6. 3| follows from Rashevski- 
on page 135 



Chow's Theorem 3.19 



It is not clear how to deduce the large-time local controllability of Example |6.4 



(more precisely (6.13 l) from already known results. More interestingly, the return 



method gives some new results in the following cases: 

- for the stabilization of driftless control affine systems (see Section 

- for the controllability of distributed control systems (see Section 



Section 6.3 I 



11.2.1), 



6.2 



and 



6.2. Controllability of the Euler and Navier-Stokes equations 

In this section, we show how the return method can be used to give control- 
lability results for the Euler and Navier-Stokes equations. Let us introduce some 
notation. Let I G {2,3} and let f2 be a bounded nonempty connected open subset 
of M. 1 of class C°°. Let r be an open subset of T := dCl and let Cl be an open 
subset of CI. We assume that 



(6.21) 



To U Cl + 



The set r , resp. Cl 0l is the part of the boundary T, resp. of the domain CI, on 
which the control acts. The fluid that we consider is incompressible, so that the 
velocity field y satisfies 

div y = 0. 

On the part of the boundary T\ro where there is no control, the fluid does not 
cross the boundary: it satisfies 



(6.22) 



v ■ n = on r\r , 



where n denotes the outward unit normal vector field on I\ When the fluid is 



viscous, it satisfies on r\ro, besides (6.22), some extra conditions which will be 



specified later on. For the moment, let us just denote by BC all the boundary 



conditions [including (6.22 I ) satisfied by the fluid on r\r . 
Let us introduce the following definition. 
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Definition 6.5. A trajectory of the Navier-Stokes control system (resp. Euler 
control system) on the time interval [0,T] is a map y : [0,T] x f2 — » K' such that, 
for some function p : [0,T] xll-tl, 

(6.23) -| - vAy + (y ■ V)y + Vp = in [0, T] x (U\ft Q ), 
at 

(6.24) (resp. % + (y ■ V)y + Vp = in [0, T] x (H\O )) 

at 

(6.25) div y = in [0, T] x U, 

(6.26) y(t, •) satisfies the boundary conditions BC on T\ro, Vi G [0,T]. 



The real number v > appearing in (6.231 is the viscosity. In Definition 6.5 
and throughout the whole book, for A : Q. -» R ( and B : -» K ; , (A- V)-B : -> ^R 1 
is defined by 

((A ■ V)S) fc := X>'^— ' V* G {1, . . . , 0- 



Moreover, in Definition |6.5| and throughout this section, we do not specify in general 
the regularities of the functions considered. For the precise regularities, see the 
references mentioned in this section. 

Jacques-Louis Lions's problem of approximate controllability is the following 
one. 

Open Problem 6.6. Let T > 0, let y° : Q. -> R l and y 1 : O -> E' 6e too 
functions such that 

(6.27) div y° = in H, 

(6.28) div y 1 = in O, 

(6.29) y satisfies the boundary conditions BC on r\ro, 

(6.30) y satisfies the boundary conditions BC on T\To. 

Does there exist a trajectory y of the Navier-Stokes or the Euler control system such 
that 

(6.31) i/(0, ■) = y° m U, 
and, for an appropriate topology (see |327| 1328] ). 

(6.32) y(T, ■) is "close" to y 1 in U? 

In other words, starting with the initial data y° for the velocity field, we ask whether 
there are trajectories of the considered control system (Navier-Stokes ifv>0, Euler 
ifv = 0) which, at a fixed time T, are arbitrarily close to the given velocity field y 1 . 

If this problem always has a solution, one says that the considered control 
system is approximately controllable. 



Note that (6.231, (6.251, (6.26) and (6.311 have many solutions. In order to 



have uniqueness one needs to add extra conditions. These extra conditions are the 
controls. 



I'll 
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In the case of the Euler control system, one can even require instead of (6.32) 
the stronger condition 



(6.33) 



v(T,-)=y 1 



n. 



If y still exists with this stronger condition, one says that the Euler control system 
is globally controllable. Of course, due to the smoothing effects of the Navier- 
Stokes equations, one cannot expect to have (6.331 instead of (6.32) for general y . 



We have already encountered this problem for the control of the heat equation in 



Section 2.5 Proceeding as in Section 2.5 we replace, in Section 6.2.2 (6.33) by 



another condition in order to recover a natural definition of controllability of the 
Navier-Stokes equation. 

This section is organized as follows: 

1. In Section|6.2.1| we consider the case of the Euler control system. 

we consider the case of the Navier-Stokes control system. 



2. In Section 



6.2.2 



6.2.1. Controllability of the Euler equations. In this section the bound- 



ary conditions BC in (|6.26|, (|6.29|), and (|6.30[) are, respectively, 
(6.34) 



y(t, x) ■ n{x) = 0, V(t, x) € [0, T] x (T\T ), 



(6.35) 



y°(x) -n{x) 

(6.36) y 1 {x)-n(x) 

For simplicity we assume that 



= 0, Vxer\r , 
= o, Vs e r\r . 

^0 = 0, 



i.e., we study the case of boundary control (see |112j when tt ^ and 1 = 2). In 
this case the control is 

1. y ■ n otlTq with JL y ■ n = 0, 

2. curl y if I = 2 and the tangent vector (curl y) x n if I = 3 at the points of 
[0,T] x T where y ■ n < 0. 



These boundary conditions, (6.34 1, and the initial condition (6.31 1 imply the unique- 



ness of the solution to the Euler equations (6.24 1 — up to an arbitrary function of 



t which may be added to p and for suitable regularities; see also the papers [257 
by Victor Judovic and |271] by Alexandre Kazhikov, for results on uniqueness and 
existence of solutions. 

Let us first point out that, in order to have controllability, one needs that 

(6.37) To intersects every connected component of V. 

Indeed, let C be a connected component of T which does not intersect To and assume 
that, for some smooth oriented Jordan curve 70 on C (if I = 2, one takes 70 = C), 



(6.38) 

but that 
(6.39) 



y° ■ ds + 0, 



y \x) = o,\/x eC. 



Then there is no solution to our pr oblem , t hat i s, there is no y : [0, T] x f2 — > K 2 
and p : [0,T] x U -> R such that (|6.24|, J6.25), (|6.3l|, (|6.33|, and (|6.34[) hold. 
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L<ir, 



Indeed, if such a solution (y,p) exists, then, by the Kelvin circulation theorem (see, 
for example, [38, Equality (5.3.1), page 273]), 



(6.40) 



/ : 



y(t,-) -ds 



y -ds,Vte[0,T], 



7o 



where "/(t) is the Jordan curve obtained, at time t G [0, T], from the points of the 
fluids which, at time 0, were on 70 ; in other words, ^(t) is the image of 70 by the 
flow map associated to the time- varying vector field y. But, if 70 does not intersect 
r , (|6.34| shows that j(t) C C, for every t € [0,T]. Thus fl6.33|, fl6.38|, (|6.39[) and 



(6.401 are in contradiction. 



Conversely, if (6.37 1 holds, then the Euler control system is globally control- 



lable: 

Theorem 6.7. Assume that V intersects every connected component of T. 
Then the Euler control system is globally controllable. 



Theorem 6.7 has been proved in 



1. |104j when O is simply-connected and 1 = 2, 

2. |112j when £7 is multi-connected and 1 = 2, 

3. [194] , by Olivier Glass, when £1 is contractible and / = 3, 

4. [195] , by Olivier Glass, when £7 is not contractible and I = 3. 

The strategy of the proof of Theorem 6.7 relies on the "return method" . Applied to 



the controllability of the Euler control system, the return method consists of looking 



for (y,p) such that (6.24), (6.251, (6.311, (6.33) hold, with y = y,p = p, y 



y 







and such that the linearized control system along the trajectory y is controllable 



under the assumptions of Theorem 6.7 With such a (y,p) one may hope that there 
exists (y,p) — close to (y,p) — satisfying the required conditions, at least if y° and 
y 1 are "small". Finally, by using some scaling arguments, one can deduce from the 
existence of (y,p) when y° and y 1 are "small", the existence of (y,p) even though 
y° and y 1 are not "small" . 

Let us emphasize that one cannot take (y,p) = (0,0). Indeed, with such a 
choice of {y,p), ( |6.24[ ), ( |6.25[ ), ( |6.3l[ ), ( |6.33[ ) hold, with y = y,p = p, y° = y 1 = 0, 
but the linearized control system around y = is not at all controllable. Indeed, 
the linearized control system around y = is 



(6.41) 



div z = in [0,T] x n, 



(6.42) 



z 



Vtt = in [0,T] x n, 



z(t, x) ■ n(x) = 0, v(t, x) e [0, t] x (r\r ). 



Taking the curl of (6.42), one gets 



cteurl z 
dt 



0. 



which clearly shows that the linearized control system is not controllable (one can- 
not modify the curl using the control). 

Thus, one needs to consider other (y,p)'s. Let us briefly explain how one 
constructs "good" (y,p)'s when I = 2 and £2 is simply connected. In such a case, 
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one easily checks the existence of a harmonic function 9 in C°°(0) such that 

V0(x) / 0, \/x g n, 

|^ = o on r\r . 

on 
Let a g C°°([0, T]) vanishing at and T. Let 



(6.43) 



1 



(y,p)(t,x) = (a(t)Ve(x),-a'(t)6(x) - -a 2 (t)\V6(x)\ 2 ) 



Then ( |6.24| , ( |6.25| , ( |6.31[ ) and ( |6.33| hold, with y = y,p = p, y° = y 1 = 0. More- 
over, using arguments relying on an extension method similar to the one described 
(see also [426, Proof of Theorem 5.3, pages 688- 



in Section 



2.1.2.2 



by David 

Russell and [332J by Walter Littman) , one can see that the linearized control system 
around y is controllable. 

When To does not intersect all the connected components of V, one can get, if 
1 = 2, approximate controllability and even controllability outside every arbitrarily 
small neighborhood of the union L* of the connected components of V which do 
not intersect Vq. More precisely, one has the following theorem, which is proved in 

ra. 

Theorem 6.8. Assume that I = 2. There exists a constant cq depending only 
on fl such that, for ever y r a s above , every T > ; ever y e > 0, and every y°,y l 
in C°°(il;K 2 ) satisfying (6.21), (6. 28), (6.35) and (6.36), there exists a trajectory 
y of the Euler control system, on [0,T] satisfying (6.31), such that 

(6.44) y{T,x) = y 1 (x), \/x g O such that dist(x,T*) > e, 

(6.45) \\y(T, .)|U- < Co (I|2/°IIl2 + UWl* + \\curl y°\\ L ~ + \\curl y l \\ L ~). 



In (6.44), dist(x,r*) denotes the distance of i to T*, i.e. 
(6.46) dist (a;, T*) = Min {\x -x*\\x* G T*}. 



cxd and so Theorem 6.8 implies Theorem 6.7 



We use the convention dist (x, 0) 

In (6.451, || • ||l'-, for r g [l,+oo], denotes the L r — norm on SI 



Let us point out that, J/ ,?/ 1 and T as in Theorem 6.8 being given, it follows 



from (6.44 1 and (6.451 that, for every r in [l,+oo), 
(6.47) 



lim \\y{T,- 

6^0 + 



y'hr 



0. 



for 



Therefore, Theorem 6.8 implies approximate controllability in the space U 
every r in [l,+oo). 

Let us also notice that, if V* ^ 0, then, again by Kelvin's circulation theorem, 
approximate controllability for the L°°-norm does not hold. More precisely, let us 
consider the case / = 2 and let us denote by T\, . . . , T* k the connected components 
of T which do not meet r . Let y ^ 1 in C°°{n;R 2 ) satisfy ( |6.27| , ( |6.28| , ( |6.35| ) 
and (6.361. Assume that, for some i g {1, . . . ,k}, 

y°-ts^ [ y 1 - ds. 
Then, for s > small enough, there is no trajectory y of the Euler control system 



on [0,T] satisfying (6.311 such that 

(6.48) M T,.)-y^\\ LO 



<£. 
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One may wonder what happens if, on the contrary, one assumes that 
(6.49) / y°-ds = [ y 1 -ds, Vi G {!,..., k}. 



Then Olivier Glass proved that one has approximate controllability in L°° and even 
in the Sobolev spaces W 1,p for every p G [l,+oo). Indeed he proved in |196j the 
following theorem. 

Theorem 6.9. A ssume t hat 1 = 2. F o r ever y T > 0, and every y°,y 1 in 
C°°{n;R 2 ) satisfying \6.2J^ , \6.28\ , Ij6.35\ ), \6.36\j and \6.49\ l, there exists a se - 
quence (y k )k^N of trajectories of the Euler control system on [0,T] satisfying (6.31) 
such that 



(6.50) 
(6.51) 



y k (T,x) = y l (x), Va; G such that dist(x,T*) ^ 1/fc, Vk G N, 
y k (T,-) ->y x mW hp {n) as k -> +oo, Vp S [l,+oo). 



Again the convergence in (6.51 ) is optimal. Indeed, since the vorticity curl y is 
conserved along the trajectories of the vector field y, one cannot have the conver- 
gence in W 1 ' 00 . In order to have convergence in W l '°° , one needs to add a relation 
between curl y° and curl y 1 on the r, for i G {1, . . . , I}. In this direction, Olivier 
Glass proved in |196j : 

Theore m 6.1 0. Assu m e tha t I = 2 Let T > and let y°,y l in C°°(r2;IR 2 ) 
be such that (6.21), (6.28), (6.35), (6.36) and (6.49) hold. Assume that, for every 
i G {I,..., I}, there exists a diffeomorphism Di of T* preserving the orientation 
such that 

curl y = (curl y ) o Di. 

Then there exists a sequence (y k )k^N of trajectories of the Euler control system on 
[0, T] satisfying {6.31\ , {6.50\ and 

(6.52) y k {T, ■) -> y 1 in W 2 < p (tt) as k -> +oo, Vp G [1, +oo). 

Again, one cannot expect a convergence in W 2,oa without an extra assumption 
on y° and y ; see [196] . 

Let us end this section by mentioning that, for the Vlasov-Poisson system 
and for the 1-D isentropic Euler equation, Olivier Glass, using the return method, 
obtained controllability results in [1981 1200| . 

6.2.2. Controllability of the Navier-Stokes equations. In this section, 
v > 0. We now need to specify the boundary conditions BC. Three types of 
conditions are considered: 

- Stokes boundary condition, 

- Navier boundary condition, 

- Curl condition. 

The Stokes boundary condition is the well-known no-slip boundary condition 

(6.53) 2/ = 0onr\r , 



which of course implies (6.221. 



1'IS 
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The Navier boundary condition, introduced in |375J . imposes condition (6.22 I 
which is always assumed, and 



.54) 



ay-T- 



(1 



=1,3=1 



\dxi 



dy j 

dx l 



t 1 = o on r\r , Vr e ti\ 



where a is a constant in [0, 1). In (6.54 1 



= (n\...,n'), t= {t x ,...,t 1 ) andTr 
is the set of tangent vector fields on the boundary T . Note that the Stokes boundary 
condition (6.531 corresponds to the case a = 1, which we will not include in the 



Navier boundary condition considered here. The boundary condition (6.54 1 with 
a = corresponds to the case where the fluid slips on the wall without friction. It is 
the appropriate physical model for some flow problems; see, for example, the paper 
|192j by Giuseppe Geymonat and Enrique Sanchez-Palencia. The case a € (0, 1) 
corresponds to a case where the fluid slips on the wall with friction; it is also used in 
models of turbulence with rough walls; see, e.g., [304] , Note that in [101] Francois 
Coron derived rigorously the Navier boundary condition (6.54 1 from the boundary 



condition at the kinetic level (Boltzmann equation) for compressible fluids. Let us 
also recall that Claude Bardos, Frangois Golse, and David Levermore have derived 
in [32, 33 1 the incompressible Navier-Stokes equations from a Boltzmann equation. 

2 and if r is the unit 
' ■' ' a 54 I is equivalent 



Let us point out that, using (6.22), one sees that, if I 



tangent vector field on T such that (n, r) is a direct basis of 1 
to 



with a e C°°{T;. 
(6.55) 



ay 
V) defined by 

a(x) 



t + curl y = on r\Fo 



-2(1 -a)n(x)+a 



1 



Vxer, 



where k is the curvature of T defined through the relation 

dn 



In fact, we will not use this particular form of (6.55 I in our considerations: Theorem 
6.14| below holds for every a £ C°°(r; R). 

Finally, the curl condition is considered in dimension 1 = 2. This condition is 
condition (6.221, which is always assumed, and 



(6.56) 



curl y = on r\r 



It corresponds to the case a = in (6.55) 



As mentioned at the beginning of Section |6.2[ due to the smoothing property 



of the Navier-Stokes equation, one cannot expect to get (6.331, at least for general 



y . For these equations, the good notion for controllability is not passing from a 



given state y to another given state y . As already mentioned (see Section 2.5.2 I 



the good definition for controllability, which is due to Andrei Fursikov and Oleg 
Imanuvilov [1851 1187] , is passing from a given state y° to a given trajectory y . 
This leads to the following, still open, problem of controllability of the Navier-Stokes 
equation with the Stokes or Navier condition. 

Open Problem 6.11. Let T > 0. Let y 1 be a t raject ory of the N avier-Stokes 
control system on [0,T]. Let y° € C°°(n;R l ) satisfy {6.2^ and {6.2$. Does there 
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exist a trajectory y of the Navier-Stokes control system on [0,T] such that 

(6.57) y(0,x) = y Q (x),Vx£~n, 

(6.58) y(T,x)=y 1 (T,x),Vxem 

Let us point out that the (global) approximate controllability of the Navier- 
Stokes control system is also an open problem. Related to Open Problem |6.11| one 
knows two types of results: 

- local results, 

- global results, 

which we briefly describe in Section |6.2 .2 . 1 1 and Section [6. 2. 2. 2\ respectively. 

6.2.2.1. Local results. These results do not rely on the return method, but 
on observability inequalities related to the one obtained for the heat equation in 
Section 
Section 



2.5 



2.5 



(see (2.398)). Compared to the case of the heat equation considered in 
the main new difficulty is to estimate the pressure. Let us introduce 
the following definition. 

Definition 6.12. The Navier-Stokes control system is locally (for the Sobolev 
H 1 -norm) controllable along the trajectory y 1 on [0,T] of the Navier-Stokes contro l 



system if there exists e > such that, for every y° £ C°°(tt;M. ) satisfying (6.27l 



( |6.29| and 

\\y°-y 1 (0,-)\\HHn)<e, 
there exists a trajectory y of the Navier-Stokes control system on [0, T] satisfying 



(6.571 and (6.58) 



Then one has the following result. 

Theorem 6.13. The Navier-Stokes control system is locally controllable (for the 
Navier or Stokes condition) along every trajectory y 1 of the Navier-Stokes control 
system. 

Many mathematicians have contributed to this result. Let us mention the main 
papers: 

- Andrei Fursikov and Oleg Imanuvilov in |184|, 1187] treated the case I = 2 
and the Navier boundary condition. 

- Andrei Fursikov in [181j treated the case where To = T. 

- Oleg Imanuvilov in [244], 1245] treated in full generality the case of the 
Stokes condition. In [244" l |245] . Enrique Ferhandez-Cara, Sergio Guerrero, 
Oleg Imanuvilov and Jean-Pierre Puel in |167] weakened some regularity 
assumptions. 

- Sergio Guerrero in |207j treated in full generality the case of the Navier 
boundary condition. 

6.2.2.2. Global results. Let d e C°{U;R) be defined by 

d{x)= dist{x,T) = Min {\x-x'\;x' G T}. 
In [111] the following theorem is proved. 



Theorem 6.14. Let T > 0. Let y° and y 1 in H 1 ^,®?) be such that (6.21) 



and (6.28) hold and 

curl y° e L°°(fi) and curl y 1 £ L°°(fi), 
y ■ n = 0, y ■ n = on T \ Fq. 
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Let us also assume that (6.54) holds for y := y° and for y := y 1 . Then there exists a 
sequence (yk;Pk)k£N of solutions of the Navier-Stokes control system on [0,T] with 



the Navier boundary condition (6.54) such that 

..o 



(6.59) 
(6.60) 
(6.61) 
(6.62) 
(6.63) 
and such that, as k 

(6.64) 



Uk(0, : ) = V 

yk and pk are of class C°° in (0, T] x ft, 

y k eL 2 ((0,T),H 2 (nf), 

y kt eL 2 ((0,T),L 2 (nf), 

Pk eL 2 ((o,T),H\n)), 

-» +oo, 

d{xY\y k {T, x) - y\x)\dx -> 0, V^ > 0, 



0, 



(K) 



(6.65) lly*(T,0-y 1 lk-i.«.(n) 

and, for every compact K contained in ft U To. 

(6.66) ||l/fc(r,-) - z/||l°°(a:) + 1 1 curl y k {T,-) -curl j/ 1 ^ 

In this theorem, W '°°(ft) denotes the usual Sobolev space of first derivatives 
of functions in L°°(ft) and || ■ ||vy- loo (n) on e of its usual norms, for example the 
norm given in [3] Section 3.12, page 64]. 

Rem ark 6.15. In [111 we said that, if y° is, moreover, of class C°° in ft and 
satisfies (6.29), then the (y k ,p k ) could be chosen to be of class C°° in [0,T] x ft 
(compared with (6.60)). This is wrong. In order to have regularity near t = 0, 



one needs to require (as in the case where there is no control) some extra nonlocal 
compatibility conditions on y . One can easily adapt the paper [4'r9j by Roger 
Temam (which deals with the case of the Stokes conditions) to find these compati- 
bility conditions. When there is a control, the compatibility conditions are weaker 
than in the case without control but they still do exist if Tq ^ T. 



For the proof of Theorem |6.14| as in the proof of the controllability of the 
2-D Euler equations of incompressible inviscid fluids (see Section 6.2.1), one uses 



the return method. Let us recall that it consists of looking for a trajectory of the 
Navier-Stokes control system y such that 

(6.67) y(0, ■) = y(T, •) = in ft, 

and such that the linearized control system around the trajectory y has a controlla- 
bility in a "good" sense. With such a y one may hope that there exists y — close to 
y — satisfying the required conditions, at least if y° and y 1 are "small" . Note that 
the linearized control system around y is 

(6.68) -^ - vAz + (y ■ V)z + (z ■ V)y + Vtt = in [0, T] x (U\n ), 



01 



(6.69) 
(6.70) 
(6.71) 



div z = in [0,T] x ft, 
■n = 0on [0,T] x (r\r ), 
f curl z = Oon [0,T] x (r\r ) 
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In [184j H87j Andrei Fursikov and Oleg Imanuvilov proved that this linear control 
system is controllable (see also [323] for the approximate controllability) . Of course 
it is tempting to consider the case y = 0. Unfortunately it is not clear how to 
deduce from the controllability of the linear system (6.681 with y = 0, the existence 



of a trajectory y of the Navier-Stokes control system (with the Navier boundary 
condition) satisfying (6.31) and (6.32) if y° and y 1 are not small. (The nonlinearity 



sounds too big to apply the method of Section 4.3 ) For this reason, one does not 
use y = 0, but y similar to the one defined by (6.431 to prove the controllability of 
the 2-D Euler equations of incompressible inviscid fluids. These y's are chosen to 
be "large" so that, in some sense, "A" is small compared to "(y ■ V) + ( -V)|/". 



Remark 6.16. In fact, with the y we use, one does not have (6.671: one only 
has the weaker property 

(6.72) y(0, •) = 0, y(T, •) is "close" to in U. 

However, the controllability of the linearized control system around y is strong 
enough to take care of the fact that y(-, T) is not equal to but only close to 0. A 
similar observation can be found, in a different setting, in |471| . With the notation 
introduced by Hector Sussmann in [471 1, y plays the role of £* in the proof of 
[4711 Theorem 12] and the Euler control system plays for the Navier-Stokes control 
system the role played by Q for T . 



Note that (6.64 I, (6.65), and (6.66) are not strong enough to imply 
(6.73) \\Vk(T,-)- y'hmD^O, 

i.e., to get the approximate controllability in L 2 of the Navier-Stokes control system. 



But, in the special case where Tq = T, (6.64), (6.651, and (6.66) are strong enough 



to imply (6.73). Moreover, combining together a proof of Theorem 6.13 (see [184, 



I187J ) and the proof of Theorem 6.14 one gets the following theorem. 

Theorem 6.17 ([123 ). The Open Problem 6.11 has a positive answer when 
To = r and I = 2. 

This result has been recently generalized to the case I = 3 by Andrei Fursikov 
and Oleg Imanuvilov in [188j. Let us also mention that, in [155j . Caroline Fabre 
obtained, in every dimension, an approximate controllability result of two natural 
"cut off" Navier-Stokes equations. Her proof relies on a general method introduced 
by Enrique Zuazua in [516 to prove approximate controllability of semilinear wave 
equations. This general method is based on the HUM (Hilbert Uniqueness Method, 
due to Jacques-Louis Lions [326j ; see Section 1.4) and on a fixed-point technique 
introduced by Enrique Zuazua in [5151 1516] and that we described in Section 3.5.1 
and in Section l4~3l 



Remark 6.18. Roughly speaking, we have deduced global controllability re- 
sults for the Navier-Stokes equations from the controllability of the Euler equations. 
This is possible because the Euler equations are quadratic and the Navier-Stokes 
equations are the Euler equations plus a linear "perturbation" . See Section |3.5.2| 
where we have studied such phenomena for control systems in finite dimension. 



Remark 6.19. As already mentioned in Remark |5.3| on page |185| Andrei 
Agrachev and Andrei Sarychev in [9], and Armen Shirikyan in [446] obtained global 
approximate controllability results for the Navier-Stokes equations and the Euler 
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equations of incompressible fluids when the controls are on some low modes and Cl 
is a torus. They also obtained the controllability for the Navier-Stokes equations 
from the controllability for the Euler equations by the same scaling arguments. But 
their proof of the controllability for the Euler equations is completely different. It 
relies on iterated Lie brackets and a regularity property of the Navier-Stokes and 
Euler equations for controls in W '°°{0, T). 

Remark 6.20. It is usually accepted that the viscous Burgers equation pro- 
vides a realistic simplification of the Navier-Stokes system in Fluid Mechanics. 
But Ildefonso Diaz proved in |145j that the viscous Burgers equation is not ap- 
proximately controllable for boundary controls; see also [185j . by Andrei Fursikov 
and Oleg Imanuvilov, and [208 by Sergio Guerrero and Oleg Imanuvilov. Enrique 
Fernandez- Cara and Sergio Guerrero proved in [166 that the viscous Burgers equa- 
tion is not small-time null controllable for large data (and boundary control). But 
we proved in [118 that there exists a time T such that, whatever the initial datum 
is, there exists a control which can steer the Burgers control system from this initial 
datum to rest in time T . 

For the nonviscous Burgers equation, results have been obtained by Fabio An- 
cona and Andrea Marson in [16 and, using the return method, by Thierry Horsin 
in 239j (see also [69] by Alberto Bressan and Giuseppe Coclite, and [15 by Fabio 
Ancona and Giuseppe Coclite for hyperbolic systems and BV-solutions). Note 
that, with boundary control, the nonviscous Burgers equation is not controllable 
(even if the control is on the whole boundary of Cl, which is now an open bounded 



nonempty interval of R; see 239J). By Remark 6.18 this might be the reason why 
the viscous Burgers equation is not approximately controllable for boundary control 
(even if the control is on the whole boundary of CI; see [208 ) and could explain 
the difference, for the controllability, between the Navier-Stokes equations and the 
viscous Burgers equation. Recently, Marianne Chapouly, using the return method, 
obtained in [87 a global controllability result in arbitrary time for the nonviscous 
Burgers equation when, besides control on the whole boundary, there is a constant 
control inside. It seems that this constant control plays the role of the pressure in 
the Euler equations. 

Remark 6.21. It would be quite interesting to understand the controllability of 
incompressible fluids in Lagrangian coordinates. Recently Thierry Horsin obtained 
results in this direction for the viscous Burgers equation in [241] and for the heat 
equation in |240j . 

Remark 6.22. Recently, there has been a lot of research on the interaction 
fluid with other materials. Let us mention, in particular, 

- the paper |330j by Jacques Louis Lions and Enrique Zuazua, the papers 
|377| |37S] by Axel Osses and Jean-Pierre Puel, on the controllability of 
an incompressible fluid interacting with an elastic structure, 

- the papers |147l 1147] by Anna Doubova and Enrique Fernandez-Cara on 
the controllability of one-dimensional nonlinear system which models the 
interaction of a fluid and a particle, 

- the paper |514j by Xu Zhang and Enrique Zuazua on the controllability of 
a linearized and simplified 1-D model for fluidstructure interaction. This 
model consists of a wave and a heat equation and two bounded intervals, 
coupled by transmission conditions at the point of interface. 
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6.3. Local controllability of a 1-D tank containing a fluid modeled by 

the Saint- Venant equations 

In this section, we consider a 1-D tank containing an inviscid incompressible 
irrotational fluid. The tank is subject to one-dimensional horizontal moves. We 
assume that the horizontal acceleration of the tank is small compared to the gravity 
constant and that the height of the fluid is small compared to the length of the tank. 
These physical considerations motivate the use of the Saint- Venant equations [430 
(also called shallow water equations) to describe the motion of the fluid; see e.g. 
|144l Sec. 4.2]. Hence the considered dynamics equations are (see the paper [150 
by Francois Dubois, Nicolas Petit and Pierre Rouchon) 

(Hv) x (t,x) 
gH+^r) (t,x) 



(6.74) 
(6.75) 
(6.76) 
(6.77) 

(6.78) 



H t (t,x) 
v t (t,x] 



v(t,0) 
ds 

d7 
dt> 

~dT 



o, te [o,T], x e [0,L], 

-u(t), te [o,T], xe [o,L], 
= v{t,L) = 0,te [0,21, 
(t) = u(t),te [0,31, 
(t) = s(t),te[o,T], 



where (see Figure ^1 , 

• L is the length of the 1-D tank, 

• H (£, x) is the height of the fluid at time t and at the position x e [0, L], 

• v (t, x) is the horizontal water velocity of the fluid in a referential attached to 
the tank at time t and at the position x e [0, L] (in the shallow water model, 
all the points on the same vertical have the same horizontal velocity), 

• u (t) is the horizontal acceleration of the tank in the absolute referential, 

• g is the gravity constant, 

• s is the horizontal velocity of the tank, 

• D is the horizontal displacement of the tank. 




Figure 2. Fluid in the 1-D tank 
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This is a control system, denoted E, where, at time t G [0,T], 

- the state is Y(t) = (H(t, -),v(t, •), s(i), £>(*)), 

- the control is u{t) G R. 

Our goal is to study the local controllability of the control system E around the 
equilibrium point 

(Y e ,u e ) :=((ff e ,0,0,0),0). 

This problem has been raised by Frangois Dubois, Nicolas Petit and Pierre Rouchon 
in [IlO]. 

Of course, the total mass of the fluid is conserved so that, for every solution of 



(6.741 to (6.76) 



(6.79) 



dt 



H(t,x)dx = 0. 



(One gets (6.79) by integrating (6.74) on [0,L] and by using (6.761 together with an 
integration by parts.) Moreover, if H and v are of class C , it follows from (6.75) 
and (6.76 I that 



(6.80) 



H x (t,0)=H x (t,L), 



which is also — u (t) / g. Therefore we introduce the vector space E of functions 
Y = (H,v,s,D) G C^O.L]) x C l ([0,L)) x R x E such that 



(6.81) 
(6.82) 



H x (0) = H x (L), 
v(0) =v(L) = 0, 



and we consider the affine subspace y C E consisting of elements Y = (H, v, s, D) € 
E satisfying 



(6.83) 



H(x)dx = LH e 



The vector space E is equipped with the natural norm 

l^h=ll^llci([0^]) + IHIci([0,£]) + k 
With these notations, we can define a trajectory of the control system E. 



\D\. 



Definition 6.23. Let T\ and Ti be two real numbers satisfying T\ ^ Ti. A 
function (Y,u) = ((H,v, s,d),u) : [Ti,T2] — > y x R is a trajectory of the control 
system E if 

(i) the functions H and v are of class C 1 on [Ti, T2] x [0, L], 
(ii) the functions s and D are of class C 1 on [T± , T2] and the function u is 
continuous on [Ti,T2], 



(iii) the equations (6.74 1 to (6.78) hold for every (t,x) G [Ti^] x [Q,L]. 



Our main result states that the control system E is locally controllable around 
the equilibrium point (Y e ,u e ). More precisely, one has the following theorem. 
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Theorem 6.24 f |116j ). There exist T > 0, C > and r\ > such that, for 
every Y° = (H° , v°, s°, D°) G y, and for every Y 1 = (if 1 , v 1 , s 1 , D 1 ) G y such 
that 

II ttO /T" || I IL.OJI <^ r7 II ff 1 TT \\ I |L.1|| <^ n 

II e llc 1 ([0,L]) "f" IT HcHIO.i]) '' H e llc l ([0,£]) ^ II IICHIO.i]) '' 



I* 1 -* ! 



Id 1 - s°t- d°\ < 



V: 



there exists a trajectory (Y,u) : t £ [0,T] h ((H (t) , v (t) , s (t) , D (*)) , u (*)) € 
^xlo/ i/ie control system S, smc/i i/iai 

(6.84) r(0) =F° andy(T) = y 1 , 
and, /or every t G [0,T], 

(6.85) ||tf (t) - ff e ||cH[o,L]) + Ik (t)llcH[o,L]) + \ u (*)l < 



Qa(^/||ff° - tfellcW]) + ll«°llci([0,L]) + l^ 1 " #ell 



■ r'i[0,i]) + ll x,1 llc l ([0,i])J 



+ Qa(|3 1 -s°, , 

As a corollary of this theorem, any steady state Y 1 = (H e ,0,0, D 1 ) can be 
reached from any other steady state Y° = (H ei 0,0, D ). More precisely, one has 
the following corollary. 



Corollary 6.25 ( [116| ). LetT, C^andrj be as in Theorem 6.24 



Let D° and 



D 1 be two real numbers and let r]\ G (0, rj\ . Then there exists a trajectory 



(Y,u):[0,T(\D 1 -D°\ + r ll )/r ll } 
t 



yx 



~ ((H(t),v(t),s(t),D(t)),u(t)) 
of the control system E, such that 

(6.86) y(0) = (H e , 0, 0, D°) and y(T(|U 1 - D°\ + m )/ m ) = (H e ,0, 0, D 1 ), 
and, for every t G [0,T(\D x - D°\ + T)i)/tii], 



(6.87) 



\H(t)-H, 



ellCHlO.L]) 



\\v(t)\\ 



CH[0,L]) 



■(*)!< Qff7i- 



We will first explain, on a toy model in finite dimension, the main ideas for 
proving Theorem |6.24| The rest of the section will then be devoted to a more 
detailed description of the proof of Theorem |6.24| 

In order to motivate our toy model, recalling that H° and H 1 have to be close 
to H e , let us write 

H° = H e + eh" + e 2 h° 2 , v° = ev" + e 2 v° 2 , s° = es?, D° = erf?, 
H 1 = H e + eh\ + e 2 h\, v 1 = ev\ + e 2 v\, s 1 = esj, D 1 = ed\, u = eu 1 , 

where e > is small, and let us study the problem of second order in e. (In fact, 
we should also write the terms in e 2 for u, s, D but they turn out to be useless.) 



Let us expand the solution (H,v,s,D) of (6.74 1 to (6.781 together with 

H(0,x) = H°{x), v(0,x) = v°(x), s(0) = s°, 13(0) = 13°, 
as power series in e: 



H = H e + eh\ + e 2 h 2 + ...,« = ev\ + e 2 v 2 + ■ ■ ■ , s = e«i, D = eDi,u = eu\. 
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Identifying the power series expansions up to order 2 in e, one gets 
h lt + H e v lx = 0, t G [0,T], xe [0,L], 
v lt +gh lx = - Ul {t),te [0,31, zG [0,Z], 



(6.88) 



«i(t,0)=v 1 (t,L)=0,te [0,T], 
dsi 



d/ 
d£» 



d/ 



(t)=«i(t),te [0,31, 

1 -(t) = s l (t),t&[0,T], 



( h 2t + H e v 2x = -{h 1 v 1 ) X7 te [0,31, a; e M, 
(6.89) I v 2 t + gh 2x = -v 1 vi x ,te[0,T],xe[0,L], 

{ v x (t,0)=vi(t,L) = 0,te [0,21, 

together with the initial conditions 

/ii(0,z) = ft?(a:), «i(0,a;) = «?(»), a; G [0,L], 

si(0) = s 1 , £>i(0) = D 1 , MM) = &§(;&), i/ a (0,a:) = v°(x), x G [0,L]. 



We consider (6.88) as a control system where, at time t G [0, T], the control is Ui(t) 
and the state is (hi(t, •), Vi(t, •), Si(*)j -°iW) G ^([O.X]) X ^([O,!-]) xIxRand 
satisfies 

fi(i, 0) = t>i(t, L) =0, hi(t, L — x) = —h\(t,x), v\(t, L — x) = v\(t, x), x G [0, £•]. 

Note that, by [150], this linear control system is controllable in any time T > 
L/y/H e g. This can be proved by means of explicit solutions as for a transport 
equation in Section 2.1.2.1 (For controllability in Sobolev spaces, one can also get 
this controllability by proving an observability inequality by means of the multiplier 
method as in Section 2.1.2.3 for a transport equation.) Similarly, we consider (6.89) 
as a control system where, at time t G [0, T], the state is {h^it, •), v 2 (t, ■)) : [0, L] — > 
K 2 and satisfies 

(6.90) h 2 (t,L-x) = h 2 (t,x),h 2x {t,0) = h 2x (t,L) = 0, h 2 (t,x)dx = 0, 

Jo 

(6.91) v 2 {t, L-x) = -v 2 {t, x),xe [0, L], v 2 (t, 0) = v 2 {t, L) = 0. 

The control in this system is (h\Vi) x (t, ■) and V\V\ x {t, ■). It depends only on the 
state of the control system (6.881 and is quadratic with respect to this state. The 



first two equations of (6.881 and (6.891 are the usual wave equations. A natural 



analogue of the wave equation in finite dimension is the oscillator equation. Hence 
a natural analogue of our control system (6.88) and (6.891 is 

(6.92) xi = x 2 , x 2 = —x\ + u, 

(6.93) ±3 = Xi, Xi = —xz + 2x\x 2 , 

(6.94) s = u, D = s, 

where the state is (xi,x 2 ,Xs, Xi, s, D) G K 6 and the control u G R. This control 
system is our toy model. We call it X. 

The linearized control system of T at the equilibrium (0,0) £ R 6 x R is 

(6.95) Xi = x 2 , x 2 = —x\ + u, ±3 = Xi, Xi = —X3, s = u, D = s. 
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The linear control system (6.951 is not controllable. However, as one easily checks, 
(6.95 I is steady-state controllable for arbitrary time T, that is, for every (D°, D 1 ) G 
K. 2 and for every T > 0, there exists a trajectory ((xi, x 2 ,x 3 , x&, s, D),u) : [0, T] — > 



X R of the linear control system (6.95), such that 



asi(0) = a: 2 (0) = as a (0) = a? 4 (0) = s(0) = 0, D(0) = D°, 

xi(T) = x 2 (T) = x 3 (T) = x 4 (T) = a(T) = 0, D(T) = D 1 . 
But the same does not hold for the nonlinear control system X. Indeed, it follows 



from Example 6.4 on page 190 that if ((xi,X2,x 3 ,X4,s,D),u) : [0,T] — > R 6 x R is 
a trajectory of the control system X, such that 

*i(0) = x 2 {0) = x 3 (0) = a*(0) = *(0) = 0, 
Si(T) = x 2 (T) = x 3 (T) = x 4 (T) = s(T) = 0, D(T) / D(0), 

then T > 7r. This minimal time for steady state controllability is optimal. This 
can be seen by using the return method as in Example |6.4| on page |190} Indeed, let 
T > it and let (xi, x 2 ,x 3 , x±, u) be as in Example |6.4| except that one also requires 

fq i-r] ft 



(6.96) / xi(t)dt = 0, / x 1 {s)dsdt = 0. 

Jo Jo Jo 

Coming back to the controllability of X, let us define (s, D) : [0, T] — > R 2 by 
| = u, s(0) = 0, D = s, D(0) = 0. 



Then, using in particular (6.96), one easily sees that 

s(T) = 0, D(T) = 0. 

Moreover, straightforward computations show that the linearized control system 
along the trajectory ((xi,x 2 ,x 3 ,X4,s, D),u) is controllable if X\ is not identically 
equal to 0. Hence the return method gives the local controllability of X in time 

T > IT. 

Unfortunately, this proof for checking the local controllability heavily relies on 
explicit computations, which we have not been able to perform in the case of the 
control system S defined on page |204| Let us now present a more flexible use of 
the return method to prove the following large-time local controllability of X. 

Proposition 6.26. There exist T > and S > such that, for every a e R 6 
and every b G R 6 with \a\ < S and \b\ < 5, there exists u G L°°(0,T) such that, if 
x = (xi,x 2 ,x 3 ,X4, s, D) : [0,T] — > R 6 is the solution of the Cauchy problem 

Xi = x 2 , x 2 = —x\ + u, 
x 3 = Xi, ±4 = -x 3 + 2x\x 2 , 

s = u, D = s, 

x(0) = a, 

then x(T) = b. 

Proof of Proposition |6.26[ We prove this proposition by using the return 
method. In order to use this method, one needs, at least, to know trajectories of the 
control system X, such that the linearized control systems around these trajectories 
are controllable. The simplest trajectories one can consider are the trajectories 

(6.97) ((xj, xl xl,xi, s\D"i), u i) = (( 7 , 0, 0, 0, jt, jt 2 /2)^), 
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where 7 is any real number different from and t G [0, n], with t% > fixed. The 
linearized control system around the trajectory 

(a; 7 , u 7 ) := ((x 7 , a; 7 , xj, xj, s 7 , L> 7 ), u 7 ) 

is the linear control system 



(6.98) 



Xi = X 2 , X 2 = 


-X\ + u, 


£3 = X4, Xi = 


-x 3 + 2jx 2 , 


s = u, D = s. 





Using the Kalman rank condition (Theorem 1.16 on page KM, one easily checks 



that this linear control system (6.981 is controllable if and only if 7 7^ 0. Let us 



now choose 7 / 0. Then, since the linearized control system around (x 7 ,w 7 ) is 
controllable, there exists 8\ > such that, for every 



aEB{x*>{0),8x) := {x e 
and for every 

beB{x 1 {T 1 ),8 x ) := {x E . 
there exists u G L°°((0,ti);R) such that 



R 6 ;|x-x 7 (0)| < 8x} 
l*;\x-xr(n)\<8i}, 



x\ 
£3 



X2, X 2 

3?4 j *^4 



-X3 



u, 
2xxx 2 ,s 



u, D = S, x(0) = < 
Hence, in order to prove Proposition |6.26"| it suffices to check that: 

(i) There exist t 2 > and a trajectory (x,u) : [0,t 2 ] — > K 6 x 

system T, such that £(0) = and \x(t 2 ) — x 7 (0)| < S\. 
(ii) There exist t 3 > and a trajectory (x,u) : [0,^] — » E 6 x 
system 1, such that xfo) = and |£(0) — x 7 (ti)| < 5x- 

Indeed, by the continuity of the solutions of the Cauchy problem with respect 
to the initial condition, there exists 8 > such that 



(x(rx) = b) . 

of the control 
of the control 



and 



Xx 


= x 2 , x 2 = —xx + u, 


£3 = X4, £4 = — X3 + 2xxX 2 , s = u, 


|x(0)|<<5 


( 


Xx = X 2 , X 2 = —Xx + u, \ 


< 


£3 = X4, £4 = — X3 + 2xxx 2 , 


s = ii(t - t 2 - n), D = S, 


V 


. |z(t 2 + Ti+t 3 )| <<J / 



s. 



(\x(r 2 )-xi(0)\<8x) 



(\x(T 2 + Tx)-X-y(Tx)\<8x) 



Then it suffices to take T = t 2 + t\ + T3; see Figure [3] 

Proof of (i). In order to prove (i), we consider quasi-static deformations (see 
Chapter [mor more details on this method). Let g € C 2 ([0, 1];K) be such that 

(6.99) g(0) = 0, g(l) = 1. 
Let u : [0, 1/e] -» K be defined by 

(6.100) u(i) = 7s(ef), £ G [0, 1/e]. 
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Figure 3. Return method and quasi-static deformations 



Let x := (x\, X2, £3, x 4 , s, D) : [0, 1/e] — > K 6 be denned by 

xi = x 2 , x 2 = —Xi + w, 

X 3 = X4, X4 = -X 3 + 2X\X2, 

s = it, D = s, i(0) = 0. 



One has 
(6.101) 

(6.102) 



xi + iX2 = H I e l( ' t s ^g(£s)ds, 
'o 

X3 + 1x4 = 2i e -l( - ~~ s 'xi(s)x2(s)ds. 
Jo 



From (6.101 1 and after two integrations by parts, one gets 
xi + ix 2 =ig{et) - jg(0)e~~ lt + ie^g'(et) 



.103) 



iejg'(0)e- lt - ie 2 1 / e i{ - 8 ' f) g" \es)ds, 
Jo 



which, together with (6.991, gives 
(6.104) 



(«i(l/e), sc 2 (l/e)) -> (7, 0) as e -> 0. 



Similarly, using (6.991, (6.102), (6.103) and integration by parts, one gets 
(6.105) {x 3 {l/e),x 4 {l/e)) -> as e -> 0. 
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Finally, 
(6.106) 

(6.107) 
Hence, if 
(6.108) 



s ( l / £ ) = ~ g{z)dz, 
£ Jo 

D{l/e)= J / (/ 9(za)dz2)'l:y. 



g{z)dz = 0, / f / g(z 2 )dz 2 ) dz\ = 0, 



one gets, using (6.104), (6.1051, (6.1061 and (6.107), that 



x(l/e) -> (7, 0, 0, 0, 0, 0) as e -> 0, 
which concludes the proof of (i). 



Proof of (ii). One needs to modify, a little bit, the above construction. Now 
let g G C 2 ([0,1];R) be such that g(0) = 1 and g{l) = 0. Let g x G C l ([0,l];M) be 
such that 



.109) 



gi{z)dz = Ti, I g 1 {z 2 )dz 2 ) dzx = 0. 



Also let g 2 G C°([0, 1]; K) be such that 

el / rl 



.110) 



g 2 (z 2 )dz 2 dz x = t 1 /2. 



'0 V»i 

Finally, let u : [0, 1/e] -> R be defined by 

(6.111) u(i) = 7 ( ff (et) - egt{et) + £ 2 5 2 (ei)), « G [0, 1/e]. 

Then similar computations as for x show that 

|x(0) - ( 7 , 0, 0, 0, 7n , 7^/2) I -> as e -> 0, 
where x := (xi,X2j &3,&4) s, D) : [0, 1/e] — > R 6 is defined by 

xi = x 2 , x 2 = —xi + u, 
x 3 = x&, £4 = -x 3 + 2x\x 2 , 

s = u, D = s, 
x(l/e) =0. 



This concludes the proof of (ii) and of Proposition 6.26 



We now come back to our description of the proof of Theorem |6.24| on page |205| 
Note that the analogue of Theorem |6.24| for the control system X is the following 
proposition. 
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Proposition 6.27. There exists T > such that, for every e > 0, there 
exists r\ > 0, such that, for every a = (a 1; a 2 , a 3 , a 4 , s° , D°) € K 6 and for every 
b= (&i, &2, &3, ^4, s 1 , D 1 ) G K 6 satisfying 



loil 

N 

„oi 



|02| 
N 



■|03| 

N 

1 2?° I 



|a 4 | < ??, 

M < »?, 

■|^ 1 |<'7. 



i/jere exists a trajectory 



(x,u) : [0,T] -4l 6 xl, 

t h-> ( Xl (t) , x 2 (t) , x 3 (t) , x 4 (i) , s (t) , 2? (t) , u (t)) 

o/ i/ie control system %, such that 

x(0) = a and x(T) = b, 

and, for every t € [0,T], 

(6.112) \x x (t)\ + \x 2 (t)\ + \x 3 (t)\ + M*)| + |S(t)| + |I>(t)| + |«(t)| < e. 

This proposition is stronger than Proposition |6. 26"! because we added condition 
(6.112 I. The proof of Proposition 6.27 requires some new estimates. In particular, 
one needs an estimate on 6\ compared to 7. See |116j for the estimates for the 
control system E. 



Let us now sketch how one adapts, for our control system £ defined on page 
|204[ what we have done for the toy control system X defined on page |206| Let us 
first point out that by scaling arguments one can assume without loss of generality 
that 



(6.113) 

Indeed, if we let 



g = H e 



1. 



H*(t,x):=—H 

tie 



( Lt 



u* (t) :- 



Lt 



L 



H e g \ VH^g 



, s* (t) : 



, Lx ) , v* (t,x) 
1 



/ Lt 



VH e g' \VH e g 



\/H e g \VH e g 
( Lt \ „. , 1 



Lx 



D* (t) := 



L 



D 



Lt 



VThg 



with x G [0, 1], then equations (6.74l to (6.78) are equivalent to 

H*(t,x) + (H*v*) x (t,x) = 0, 



v* (t, x) + [H* + 



(t,x) = —u* (t) 



v*(t,0) =v*(t,l) = 0, 
ds* 

"dT 

dD* 



dl 



(t) = u* (t) , 
(*) = ** (*) 



From now on, we always assume that we have (6.1131. Since (Y,u) = ((H,v, s, D),u) 
is a trajectory of the control system S if and only if ((H, v , s — a, D — at — b) , u) is 
a trajectory of the control system E, we may also assume without loss of generality 
that s° = D° = 0. 
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The proof of Theorem |6.24| relies again on the return method. So one looks for 
a trajectory (Y, u) : [0, T] — > y x M. of the control system S satisfying 

(6.H4) y(o) = y(r) = r e , 

(6.115) the linearized control system around (Y,u) is controllable. 

Let us point out that, as already noticed by Frangois Dubois, Nicolas Petit and 
Pierre Rouchon in [150 (see also [385 by Nicolas Petit and Pierre Rouchon), 
property (6.115) does not hold for the natural trajectory (Y, u) = (Y e ,u e ). Indeed 
the linearized control system around (Y e ,u e ) is 



(6.116) 



S < 



hi 



0, 



v t + h x = -u(t) 



v(t,0) 
ds 



d/ 
dD 

~d7 



(*) 



v(t,l) 

u(t), 



0, 



(*) = a (*) 



where the state is (h, v, s, D) G JVo, with 



y := l(h,v,s,D)eE; J 



hdx = 



But (6.1161 implies that, if 
x) 



-h(0,x) and v(0, 1 



and the control is u G 

h(0,l-x) 

then 

h(t, 1 — x) = —h(t, x) and v(t, I — x) 



= v(0,x),Vx G [0,1], 
v(t,x),Vxe [0,1], vt. 



Remark 6.28. Even if the control system 



.1161 is not controllable, one can 
move, as it is proved in [150 , from every steady state (h , v , s , D ) := (0, 0, 0, D ) 
to every steady state (h , v , s , D l ) := (0, 0, 0, D 1 ) for this control system (see also 
|385j when the tank has a non-straight bottom). This does not a priori imply that 
the related property (move from (1, 0, 0, D ) to (1, 0, 0, D 1 )) also holds for the non- 
linear control system E, but it follows in fact from Corollary |6.25| that this property 
indeed also holds for the nonlinear control system S. Moreover, the fact that, for 



the control system (6.116), it is possible (see |150j ) to move from every steady state 

(/i°,v ,s ,£> ) := (OTOT?, D°) to every stead y state (h 1 , v 1 , s 1 , D 1 ) := (O^s 1 ,!) 1 ) 

D i- s o T _ D a\ 

172 — ' 



explains why in the right hand side of (6.85 I one has s 1 — s° 



D 1 



s°T - £> u 



As in [1031 ITOil \TT2\ Il23"t IT881 [194], HM\ 1457] , one has to look for more 
complicated trajectories (Y,u) in order to get (6.1151. In fact, as in |lllj and for 
our toy model T, one can require, instead of (6.114), the weaker property 

(6.117) F(0) = Y e and Y(T) is close to Y e , 



and hope that, as it happens for the Navier-Stokes control system (see Remark 6.16 
on page 



201 



and |lllj ). the controllability around (Y, u) will be strong enough to 
tackle the problem that Y(T) is not Y e but only close to Y e . Moreover, since, as it is 
proved in [150 , one can move, for the linear control system E , from Y e = (0,0,0,0) 
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to (O, , s ,D ), it is natural to try not to "return" to Y e , but to require instead of 
(6.1171 the property 



.118) 



y(0) = Y e and Y(T) is close to (1,0, s 1 ^ 1 ) 



In order to use this method, one first needs to have trajectories of the control 
system E, such that the linearized control systems around these trajectories are 
controllable. Let us give an example of a family of such trajectories. Let us fix a 
positive real number T* in (2,+oo). For 7 G (0,1] and (a, b) G K 2 , let us define 
{Y"t> a < b , u 1 ) : [0, T*] -* y x R by 



(6.119) Y^^ b {t) := 
(6.120) 



x 1— > 1 + 7 



1 \ e 

--xj,0,^t + a,^— + at + , 



Vie [0,T*], 



«T(t):=7,VtG[0,T*]. 



Then (Y 1,a,b ,u 7 ) is a trajectory of the control system E. The linearized control 
system around this trajectory is the control system 



(6.121) 



E 7 < 



h ' - \ ( 1 + r y I 2 ~- T M '' 



0, 



«t + ^a 



-« (*) > 



v (t,0) =v(t,l) = 0, 

ds 



dD 
~dt 



(*) = *(*)» 



where, at time i, the state is (h(t, -),v(t, ■), s(t), D(t)) G 3^0 an d the control is 
m(£) G K. This linear control system S 7 is controllable if 7 > is small enough 
(see |116j for a proof). Unfortunately, the controllability of E 7 does not seem to 
imply directly the local controllability of the control system S along the trajectory 
(Y" f,a ' b ,u y ). Indeed, the map from y x C°([0,T]) into y which, to any initial data 
Y° = {H°,v°,s a ,D Q ) G y and to any u G C°([0,T]) such that 



H° x (0) = fl-O(l) = -«(0), 



associates the state Y(T) G y, where Y = (H,v,s,D) : [0,T] — > [V satisfies (6.74) 
to (6.78) and Y(0) = Y , is well-defined and continuous on a small open neighbor- 



hood of (1^,0) (see e.g. [321] ) but is not of class C 1 on this neighborhood. See 
also Section |4.2.1| for a transport equation and Section |4.2.2| for a one-dimensional 
Schrodinger equation. So one cannot use the classical inverse function theorem to 
get the desired local controllability. To handle this problem, one proceeds as for the 
proof of Theorem |4.8| on page |168| one adapts the usual iterative scheme used to 
prove the existence of solutions to hyperbolic systems (see, e.g., [68 , pages 67-70], 
[1341 pages 476-478], [238) pages 54-55], [32T1 pages 96-107], [3401 pages 35-43] 
or [44%1 pages 106-116]; see also jlOU UA2[ UM\ UM\ H941 H95] for the Euler 
and the Navier control systems for incompressible fluids): one uses the inductive 
procedure 



(h n ,v n 7 s n ,D , 



l )^ (h n+l ,v n+1 ,s % 



,D r 



,u 



n+l 
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such that 
(6.122) 

(6.123) 
(6.124) 

(6.125) 
(6.126) 



h? +1 + v "h? +i 



+ 1+7 



x 



,,n+l 



K +1 + v n v n r +1 



v n+1 (t,0) 
ds n+1 



dt 
dD n+1 



(*) 



„n+l 



II 



dt 



(/) 



— U 

(t,l)=0 

"+ 1 (t) , 

"+ 1 (i) , 



ft" | r 

" +1 (t) 



n+l 



7« 



n+l 



0. 



and (h n+1 ,v n+1 ,s n+1 ,D n+1 ,u n+1 ) has the required value for t = and for t = T* . 
Unfort unately, we have only been able to prove that the control system (6.122)- 
( |6.126| , where the state is (h n+1 , v n+1 , s n+1 , D n+1 ) and the control is u n+1 , is 
controllable under a special assumption on (h n ,v n ); see |116| . Hence one has to 
ensure that, at each iterative step, (h n ,v n ) satisfies this condition, which turns out 
to be possible. So one gets the following proposition, which is proved in [116j . 

Proposition 6.29. There exist C\ > 0, fi > and j e (0,1] such that, for 
every 7 € [0,'^oj, for every (a, b) £ M 2 , and for every (Y ^ 1 ) € 3^ 2 satisfying 

\Y° - y- a ' 6 (0)| < a*7 2 a^ l^ 1 " y 7 ' a ' 6 (T*)| < /17 2 , 

i/iere exists a trajectory (Y,u) : [0,T*] — > ^ X K 0/ i/ie control system S, suc/i i/iaf 

F(0) = y° andy(T*) =Y 1 , 

(6.127) |y (t) - y^"(t)| + |«(t)| < qrrr, vt e [o,r*]. 

Remark 6.30. Let 

.2 
Let us assume that 

t e [0, r*] -> ((#"(*, •),«"(*, ■), A*). r> n W), «»(*)) 

is a trajectory of the control system £. The linearized control system (for E) around 
this trajectory is the linear control system 

(6.128) ht + v n h x + v%h + vHZ + v x H n = 0, 

(6.129) v t + h x + v n v x + vv" = -u{t), 

(6.130) v(t,0)=v(t,l) = 0, 

ds 
~dl. 
dD 

~d7 



H n 



1 + 7 



ft" 



(6.131) 
(6.132) 



(*) = «(*). 
(*) = «(*)■ 



Comparing (6.1221 with (6.128) and (6.123) with (6.1291, one sees that a solution 
t £ [0,T*] h^ ((JJ"+ 1 (i,-)^(f,-),s' :TI (t),I)"+ 1 (t)),i i ''+ 1 (t)) of (|6.122|-([6l23l)- 



(6.124 1-(6. 125 )-( 6.126 1 is not, in general, a trajectory of the linearized control sys- 



tem (6.128 1-(6.129 )-(6.130l-(6.131 1-(6.132). Hence one does not get the local con 



trollability stated in Proposition 6.29 from the controllability of linearized control 
systems, but from the controllability of other linear control systems. This is in fact 
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also the case for many other applications of the return method in infinite dimen- 
sion, for example, to the Euler equations of incompressible fluids. (For clarity of the 
exposition, in Section |6.2.1[ we have skipped this technical point that is detailed 
in the papers mentioned in this section; see, in particular, [112L I195J .) See also 
Remark |4.11| on page |172| as well as Remark |6.1| on page |189| 

One now needs to construct, for every given small enough 7 > 0, trajectories 
(Y, u) : [0, T°] -> y x R of the control system £ satisfying 

(6.133) F(0) = (1,0,0,0) and \Y(T°) - Y^ a ' b (0)\ < /17 2 , 

and trajectories (Y, u) : [T° + T* , T° + T* + T 1 } -» y x R of the control system £, 

such that 

(6.134) 

Y(T° + T 1 +T*) = (l,0,a 1 ,D 1 ) and \Y (T° + T*) - Y~ t > a > b (T*)\ < ^ 2 , 

for a suitable choice of (a, b) G R 2 , T° > 0, T 1 > 0. 

Let us first point out that it follows from [150] that one knows explicit trajec- 
tories (Y , u) : [0,T°] — > y x R of the linearized control system £0 around (0,0), 
satisfying Y l (0) = and Y l (T°) = yT' a ' fc (0). (i n f act , Frangois Dubois, Nicolas 
Petit and Pierre Rouchon have proved in |150j that the linear control system So 
is flat — a notion introduced by Michel Fliess, Jean Levine, Philippe Martin and 



Pierre Rouchon in [175]; see also Section 2.5.3 for an heat equation. They have 
given a complete explicit parametrization of the trajectories of So by means of an 
arbitrary function and a 1-periodic function.) Then the idea is that, if, as in the 



proof of (i) on page 208 one moves "slowly" , the same control u gives a trajectory 



(Y, u) : [0, T°] -> y x R of the control system £ such that ( |6.133| holds. 
More precisely, let /q € C 4 ([0,4]) be such that 

(6.135) /o = in [0,1/2] U [3,4], 

(6.136) fo(t)=t/2, Vte [1,3/2], 

(6.137) f f o (h)dt 1 = 0. 

Jo 

Let /1 e C 4 ([0,4]) and f 2 G C 4 ([0,4]) be such that 

(6.138) /1 = 0in [0,1/2]U [1,3/2] and /1 = 1/2 in [3,4], 

(6.139) f h(h)dh = 0, 

Jo 

(6.140) h = in [0, 1/2] U [1,3/2] U [3,4], 

(6.141) f h{ti)dh = 1/2. 

Jo 

Let 

D:= {(s,D) GR 2 ; \s\ < 1, |S| < l} . 

For (s,D) £ D, let f sD G C 4 ([0,4]) be defined by 

(6.142) f s ,D'=fo + Sfi+Df a . 

For e e (0, 1/2] and for 7 e R, let ut' y B : [0, 3/e] -> R be defined by 

(6.143) M ^ (t) := 7/ s ', 5 (rf) + 7/£ l5 (e(* + !))■ 
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Lei [h e -%v e -%s e f D ,Dy^\ : [0,3/e] ^C 1 ([0,l])xC 1 ([0,l])xExKbesuchthat 



(|6.116| holds for (h,v,s,D) = ( h e -' B ,v £ ' D , sl' B , Di ,J B j , u = u £ -' B and 



(^(0,.),^(0r),4; 7 s(0).^(0)) = (0,0,0,0). 
From |150j one gets that 



(6.144) 
(6.145) 

(6.146) 

(6.147) 
with 



K'l(t,x)^- 



f StD (e(t + x)) + ±f StB (e(t + 1 - x)), 

e e 



v e s 'l (t, x) =±f- s , D (e(t + x)) + 1 h,D« t + l ~ x )) 



2 4z)(rf)--4z)(^ + l)), 
e ' e 



7 



7 



^(*) = T/s,D(et) + T/^(e(*+l)), 



2_ 

E 1 



D l'l (*) = ik^ 6 *) + ^^,fl(e(< + 1)), 



£ 2 



,£>' 



(*) := / f s ,3fa)dti 



In particular, using also (6.1351 to (6.1411, one gets 
(6.148) hi% | - l.r 



- (--il v/ : 



0. 



l-2e 



(6.149) 
(6.150) 
(6.151) 
(6.152) 
(6.153) 



1 



v l$[- +t ' x 



S S D 



o, Wte 



o, 



l-2e 



7 7 
£ 2 



2e 

,V*G[0,lj. 
l-2e 



V^e [o,i], 



2e 



Df'7 



I?! 



g.£> 



£,7 



■2s 

jt, Vie ().■ 

0, Va; G [0, 1] 



l-2e 
2e 



/i E '7 ( — ,cc I =0 and ifjU [ — ,x 



s,D 



— s and .Df'X - 



7-, 7s 
2e e 2 



Let Hi 



e,7 



1 + /it'7 and F- ' 



£,7 



S,D 



s,D 
1 

e' 



I Hi'J.jvi'^p,, s E '7 -D e 'T ) . Let us introduce 

y s,D> s,£>' s,D' s,D J 



'-■•- - t/^(i) + 2 4b(i + £) = 2 + 7 



£,7 



"/ 



^,s(i) 



7 



a^Mi + e) 



s.D 



Using ( |6.119[ ), ( |6.148[ ), ([6.149}, (|6.150} and (|6.15l|), one gets 
(6.154) 



t^£,7 
s,D 



and, if ee (0,1/(2(1** + 1))], 



.155) 



s,D 



1 



T s 



y7,«e,-yi 



(0), 



y7>o«,-r. 6 *; 1 (J 1 *). 
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The next proposition, which is proved in [116 , shows that one can achieve (6.133) 
with u = uj\ for suitable choices of T , e and 7. 

s.D ' 

Proposition 6.31. There exists a constant C'2 > 2 such that, for every e G 
(Ojl/Cjgj, for every (s,D) G B and for every 7 G [0,e/C]2J, there exists one and 
only one map Y-'2. '■ [0, 1/e] — > y satisfying the two following conditions: 



(YL £ '^,m £ '^) is a trajectory of the control system £ on 

Kfg(0) = (1,0,0,0), 

and furthermore this unique map Yf'? verifies 



0. 



(6.156) 



K'D W " *S W 



< Cfep 7 2 , vt e 



0, 



In particular, by (6.I4S) and (6.149) 
1 



(6.157) 



.D 



C l ([0,L]) 



s.D 



7 X 

1 2 



CHIO.L]) 



c&i 2 



Similarly, one has the following proposition, which shows that (6.134 1 is achieved 

with u = wf'X for suitable choices of T , e and 7. 
s,D ' ' 

Proposition 6.32. There exists a constant C 3 > 2(T* + 1) such that, for every 
e G (0, 1/CJ3J, for every (s, D) G D, and for every 7 G [0, e/Qij], there exists one and 
only one map Yf'? : [(1/e) + T*,3/e] — > y satisfying the two following conditions: 



I Y-'?, U-'p, ) is a trajectory of the control system £ on 



e e 



s.D 



(l,0, la, 



e 2e 



T - l T n 
■s H — ^-1? 



)-ns(|) 



and furthermore this unique map Y- '? verifies 



(6.158) 



W{t) -Y! s %{t) <cq^,WG 



-+T*,- 

e e 



In particular, by (6.1 48) and (6.149) 
(6.159) 



s.D 



Ci([0,l]) 



s.D 



7 X 

1 2 



^ 



Ci([0,l]) 



CfefV- 



Let us choose 
(6.160) 



1 1 



e := 



X,m, ^'^'4'4)^' 



Let us point out that there exists C4 > such that, for every (s, D) G D and for 
every 7 G [-e,s], 



.161) 



s.D 



C 2 ([0,3/e]x[0,l]) 



C 2 ([0,3/e]x[0\l]) 



% 



which, together with straightforward estimates, leads to the next proposition, whose 
proof is omitted. 
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Proposition 6.33. There exists C 5 > such that, for every {s,D) G D, for 
every Y° = (if , v°, s°, D°) G ^ ««#l 

l^-y^T^^o, D° = o, 

and for every 7 G [0,£/Cjg], i/iere exists one and only one Y : [0,1 /e] — » 3^ suc/i 
(Y, w_'X — iJ°(0)) is a trajectory of the control system S, 

y(o) = y°, 

and i/iis unique map Y satisfies 

Y(t)-Y^(t) <qgjy°-y e | l Vie 0, 



Similarly, (6.161 1 leads to the following proposition. 

Proposition 6.34. TTiene exists C 6 > suc/i that, for every (s,D) G D, for 
every 7 G [0, e/Cjjjj], and /or every Y 1 = (H , v , s , -D 1 ) G 3^ suc/i i/iai 



y 



'-('• 



„ 7- 7 - 
0, — s, — s 



r£> 



HI e 



7-, 7s 



e 2e e< 
there exists one and only one Y : [(1/e) + T* , 3/e] — > 3^ suc/i i/iai 

(y, W-'X — H x (0j) is a trajectory of the control system S, 

y(3/ £ ) = y 1 , 

and i/iis unique map Y satisfies 



Y(t)-f^(t) <q%] 

Finally, let us define 

(6.162) 
(6.163) 

r\ := Min 



yl _ yen 

B,D v £ 



, vte 



1 ™ 3 

£ £ 



2 
£ £i 



£ 2 £i 



£ £ 1 1 



2qn(qi+ qf ' 2qn(c|+ c§) ' <%,' eft cfa' h¥ 2 h¥ 2 H£i' 



"ED 



We want to check that Theorem |6.24| holds with these constants for a large enough 
% Let y°= (iT°,v°,0,0) ey andy 1 = (H 1 , v 1 , s 1 , D 1 ) G ? be such that 



(6.164) 
(6.165) 
(6.166) 



\H°-l\ 



cmo,i]) 



Icm[o,i]) 



< T], 



I H 1 — 1 II 4- ll?) 1 !! < n 

I 1 llc 1 ([0,l]) II II ^([O,!]) ^ ''' 



Is 1 ! + ID 1 ] < Tj. 
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Let 
(6.167) 

(6.168) 
(6.169) 
(6.170) 



K := 



«i 



2% 
2Cfc 



Iff -II 



CHloM) 



ll«°llci 



CM[0,L])' 



Iff 1 -II 



c'do.t]) 



Kll 



Ci([0,L])' 



7:= Max (ko,ki,|s + ID ), 



s:= -s 1 , D:= — [ L* 1 

7 7 



e ;M?) = sl <^i-^ ! 



so that, thanks to (|6.153|, 

(6.171 

Note that, by ( [6l60| , ( [67166] ), ( [6~169] ) and ( [6~170t , 

(6.172) (s,D)eD. 

By ( [6~163| , ( [6~164t , ( [6~165J ), ( [67l66] ), d6~167] , ( [6~168| and ( [67169] ), we obtain that 



(6.173) 

Then, by Proposition 
Y = {H ,v ,so,D ) : 



7G 



0,Min 



£ £ 



<%'%/J 



6.33 (6.1631, (6.1641 and (6.1731, there exists a function 



0, l/e] -> ^ such that 



(6.174) (Yo,uf'X — ff°(0)) is a trajectory of the control system £ on 



(6.175) 
(6.176) 



io(0) = y°, 



By (6.1671, (6.1691, and (6.1761, 



(6.177) 



y^^-m" 



By Proposition 6.31 (6.160) and (6.1731, 



I s,D 



Y7> a *,-t>Ki (0) 



M7 



<^7 2 ^ 



which, together with (|6.177|), gives 

1 



(6.178) 



Y 



y7,a e>T ,6 e ; T 



$: 



M7 



Similar l y by P ropos itions |6.32| and |6.34| ( |6.160[ ), ( |6.162| , ( |6.163[ ), ( |6.165[ ), ( |6.168[ ), 
d6~169|, ([6~17i) and fl6.173|, there exists ^ = (H 1} v 1: s ll D 1 ) : [(l/e)+T*,T] -> y 
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such that 
(6.179) 

(Yi,w £ '^ — H x (0)) is a trajectory of the control system £ on [(1/e) + T* , T], 



(6.180) 
(6.181) 

(6.182) 



Y X (T) = Y\ 
Yi(t)-Y*%(t) ^Cfa\Y 1 -(l,0, 9 1 ,D 1 )\,Vte 



r * T 



y 



y7,a e , T , 



•(I- 



^nr 



By (6.1631, (6.1641, (6.165), (6.166), (6.1671, (6.1681 and (6.169) 



(6.183) 



7< To} 



From Proposition 6.29 (6.178), (6.182) and (6.1831, there exists a trajectory 



(y„u.):[o,T*]-;y 

of the control system £ satisfying 

(6.184) Y,{0)=Y° (-), 

(6.185) |y (t) - r^"-^:? (t)| < qrp 7 , vt e [o,t*], 

(6.186) y(T* 

The map (Y, it) : [0, T] — > ^ defined by 



y 1 1 - + V 



(Y (t) , U (*)) = (Y„ «) , <4 (*) - fl2(o)), Vt G 

(r(t),«(t))= (y*U-M, u * (*-^))> v * e 

(y (t),u (t)) = (y (*),«"■£ (t) - ffi(o)), vt e 



o,- 

e 
I 1 

e £ 



_ T * 



T * T 



sketch of the proof of Theorem |6.24 



(6.1661, (6.1671, (6.168), (6.169 , (6.176), (6.1811 and (6.185). This concludes our 



is a trajectory of the control system £ which, by (|6.175 ) and (6.1801, satisfies 
(6.84 1. Finally, the existence of Qj] > such that (6.85) holds follows from the 
construction of (Y,it), (|6T27|, ffU44| to ((6~147], (|6.156|), fl6l58}, |6l64|, (|6T65l 



Let us notice that, since T* > 2, our method requires, in Theorem 6.24 the 



inequality T > 2L/y/gH e . It is natural to raise the following open problem. 



Open Problem 6.35. Does Theorem 6.24 holds for every T > 2L/y / gH e ? Let 
T sj 2L/ \fg~H~ e . Is it true that Theorem \6.24 does not hold? Is it true that the 
steady-state motion problem (move from (0,0,0,1)°) to (0, 0, 0, D 1 )) is not possible 
for the time interval [0,T] if |M|c°([o,t]) * s small and D 1 ^ D°? More precisely, 
does there exist e > such that, whatever (D ,!? 1 ) £ M 2 with D° ^ D 1 is, there is 
no control u € C ([0,T]) such that ||it||c°([o,T]) ^ £ steering the control system £ 
from (0, 0, 0, D°) to (0, 0, 0, D 1 ) ? 
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Concerning this open problem, let us recall that, for the linearized control 
system S , T > L/ \/gH e is enough for the steady-state controllability (see [150] ). 
See also Theorem |9.8| on page |25 3~| and Section |9.3| for a related phenomenon. 



CHAPTER 7 



Quasi-static deformations 



The quasi-static deformation method has in fact already been used for the 



controllability of the 1-D tank (see Section 6.3 I. Note that, in connection with our 



toy model T of the 1-D tank, the linearized system of 

±1 = X 2 , X 2 = —X\ + 7, ±3 = X4, ±4 = ~X 3 + 2X1^2 

at the equilibrium (7,0,0,0) is 



with 



(7.1) 



V = A~y, 



( 1 o\ 

-10 

1 

\ 2 7 -1 0/ 



The eigenvalues of the matrix A 7 are i and —i, which have nonpositive real parts. 
This is why the quasi-static deformation is so easy to perform (even though is 
in fact not stable for y = A y y if 7 is not 0). If A 1 had eigenvalues of strictly 
positive real part, it would still be possible to perform in some cases the quasi- 
static deformation by stabilizing the equilibria by suitable feedbacks, as we are 
going to see in this chapter. 



7.1. Description of the method 

For the sake of simplicity, we explain the method in finite dimension. Let us 
consider our usual control system 



(7.2) 



x = f(x,u), 



where the state is 1 e 1", the control is u £ K m and / : R n x R m -> K" is of class 
C 1 . Let (x°,u°) 6l"xR m and (z 1 ,^ 1 ) G R n x R m be two equilibria of the control 
system (7.2 I, that is (see Definition 3.1 on page 1251 

f(x° 7 u°) = 0,f(x 1 ,u 1 ) 



0. 



We assume that (x ,11 ) and (a; 1 ,^ 1 ) belong to the same C^-path connected com- 
ponent of the set of zeros of / in K™ x K m . Our aim is to steer the control system 
(7.2) from x° to x 1 in some (possibly large) time T > 0. The method is divided 



into three steps: 



22.; 
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First step: construction of an almost trajectory. Choose a C 1 -map r £ 
[0, 1] (->• («(r),«(r)) G E™ x R m such that 

(S(0),S(0)) = (s°,u°), (x(l),«(l)) = (a 1 ,* 1 ), 
/(x(r),u(r)) = 0,Vr€[0,l]. 



Of course this map is not in general a trajectory of the control system (7.2 I 
but, if e > is small enough, then the C -map 

(x e ,u e ): [0,1/e] -> l°xR m 

t h-> (a: e (t),« e (t)):=(S(et),«(et)) 



is "almost" a trajectory of the control system (7.2 1. Indeed, as e — > 0, 
||s e - /(a; e ,M e )||co([0T/e];R™) = O(e). 

Second step: stabilization procedure. This quasi-static almost trajectory is 
not in general stable, and thus has to be stabilized. To this aim, introduce the 
following change of variables: 

z(t)=x(t)-x e (t), 

v{t) = u{t)-u e {t), 

where t £ [0,1/e]. In the new variables z,V, one gets the existence of C > such 



that, if (7.2 I holds and \z(t)\ + \v(t)\ + e is small enough, then 

(7.3) \z(t) - (A(et)z(t) + B(et)v(t))\ < C(\z(t)\ 2 + \v(t)\ 2 + e), 
where t £ [0, 1/e], and where 

A(t):=^-(x(t),u(t)) and B(t) := ^-(x(t),u(t)), 

with r = et G [0,1]. Therefore we have to "stabilize" the origin for the slowly- 
varying in time linear control system 

(7.4) z(t)=A{et)z(t) + B(et)v(t). 

We refer to |273| Section 5.3] by Hassan Khalil for this classical problem. In 
particular, it is sufficient to asymptotically stabilize, for every r € [0, 1], the origin 
for the control system z = A(t)z + B{r)v by some feedback z t— > K T z, with K T G 
A^ mi n(K) depending smoothly on t, and then define v = K et z to "stabilize" the 



origin for the control system (7.4 1. (Here "stabilize" is not in the usual sense since 
t e [0, 1/e] instead of t £ [0, oo).) 



Third step: local controllability at the end. If the control system (7.2 1 is 



locally controllable (in small time (see Definition 3.2 on page 125 I or in a fixed time 



at the equilibrium [x , u l ), we conclude that it is possible, if e > is small enough 



to steer the control system (7.2) in finite time from the point x(l/e) to the desired 
target x . 

Remark 7.1. Of course the method of quasi-static deformations can be used in 
more general situations than controllability between equilibria. It can be used for 
the controllability between periodic trajectories (see, for example, [401 Theorem 11, 
page 926] for a Schrodinger equation) or even more complicated trajectories (see, 
for example, Proposition |6 .3 1] on page |2 17] for Saint- Venant equations and page |260| 
or |43l Proposition 12] for a Schrodinger equation). 
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7.2. Application to a semilinear heat equation 

Let us now explain how to apply this method on a specific control system 
modeled by a semilinear heat equation. 

Let L > be fixed and let / : K — » K be a function of class C 2 . Let us consider 
the nonlinear control system 

ht = yx X + f(y),te(o,T),xe(o,L), 
\ y(t,0) = 0, y(t,L)=u{t),te(0,T), 

where at time t G [0, T], the state is y(t, •) : [0, L] — > K and the control is u(t) G K. 
Let us first define the notion of steady-state. 

Definition 7.2. A function y G C 2 ([0,L}) is a steady-state of the control 
system (7.5) if 

+ /O/) = o, i/(o) = o. 

We denote by 5 the set of steady-states, endowed with the C 2 topology. 



In other words, with Definition 3.1 on page 125 y G C 2 ([0, L\) is a steady-state 



of the control system (7.5) if there exists a control u e G M such that (y,u e ) is an 
equilibrium of our control system (7.5 I. 

Our goal is to show that one can move from any given steady-state to any other 
one belonging to the same connected component of the set of steady-states. To be 
more precise, let us define the notion of steady-state. 

Let us also introduce the Banach space 

Y T ={y: (0, T) x (0, L)^R;ye L 2 ((0, T);H 2 (0, L)) 

(7.6) L 

andy f eL 2 ((0,T) x(0,L))| 

endowed with the norm 

\\y\\Y T = \\y\\L2((0,T);H2(0 t L)) + \\yt\\L*((0,T)x(0,L))- 

Notice that Yt is continuously imbedded in L°°((0,T) x (0,L)). 
The main result of this section is the following. 

Theorem 7.3 ( |132j ). Let y° and y 1 be two steady-states belonging to the 
same connected component of S. There exist a time T > and a control function 
u G .ff^OjT) such that the solution y(t,x) in Yt of 

{ yt - y xx = f(y), t g (o,t), x g (o,l), 

(7.7) I y(t,0) = 0, y(t,L)=u(t),te(0,T), 
{ y(0,x)=y°(x),xe(0,L), 

satisfies y(T,-) =y 1 (-). 

Remark 7.4. In |132] we prove that, if y° and y 1 belong to distinct connected 
components of S, then it is actually impossible to move either from y° to y 1 or 
from y 1 to y°, whatever the time and the control are. 

Remark 7.5. For every T > and every u G 7J 1 (0,T), there is at most one 
solution of (7.7) in the Banach space Yt- 
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Remark 7.6. Concerning the global controllability problem, one of the main 
results in [156 , by Caroline Fabre, Jean-Pierre Puel and Enrique Zuazua, asserts 
that, if / is globally Lipschitzian, then this control system is approximately globally 
controllable; see also [243 by Oleg Imanuvilov for (exact) controllability. When / 
is superlinear the situation is still widely open, in particular, because of possible 
blowing up. Indeed, it is well known that, if yf(y) > as y / 0, then blow-up 
phenomena may occur for the Cauchy problem 



(7.8) 



y t -y xx = f(y),te(0,T),xe(0,L), 
y(t,0) = 0, y(t,L)=0,te(0,T), 

[y(0,x) = y°(x),xe(0,L). 



For example, if f(y) = y 3 , then for numerous initial data there exists T > 
such that the unique solution to the previous Cauchy problem is well defined on 
[0,T) x [0,-L] and satisfies 

lim \\y(t,-)h°°(o,L) = +oo; 

see for instance |45L 1841 13521 1507] and references therein. 

One may ask if, acting on the boundary of [0, L], one could avoid the blow-up 
phenomenon. Actually, the answer to this question is negative in general, see the 
paper [169] by Enrique Fernandez- Cara and Enrique Zuazua where it is proved 
that, for every p > 2, there exists some nonlinear function / satisfying 

\f(y)\~\y\log p (l + \y\) as \y\ - +oo 

such that, for every time T > 0, there exist initial data which lead to blow-up 
before time T, whatever the control function u is. Notice, however, that if 



|/(j/)|=of|j/|log 3 / 2 (l+|i/|) 



as \y\ 



then the blow-up (which could occur in the absence of control) can be avoided by 
means of boundary controls; see again [169J. The situation with p G [3/2, 2] is open 



as well as the case where f(y) = —y (see Section 7.2.4 for this last case 



Remark 7.7. This is a (partial) global exact controllability result. The time 
needed in our proof is large, but on the other hand, there are indeed cases where 
the time T of controllability cannot be taken arbitrarily small. For instance, in the 



case where f(y) = —y, any solution of (7.7l starting from satisfies the inequality 



/ (L - x) 4 y(T, xfdx ^ 8LT, 
Jo 



and hence, if y° = 0, a minimal time is needed to reach a given y 1 ^ 0. This result 
is due to Alain Bamberger (see the thesis [220] by Jacques Henry); see also [185 
Lemma 2.1]. 



In order to prove Theorem |7.3[ we follow the steps described previously in 
Section [711 



7.2.1. Construction of an almost trajectory. The following lemma is ob- 
vious. 
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Lemma 7.8. Let <f>o,(f>i € S. Then <pQ and (j)\ belong to the same connected 
component of S if and only if, for any real number a between (j)' (0) and 4>'i(0), the 
maximal solution of 

§ + /(v) = 0> y(0)=0 ) j/(0) = a, 

denoted by y a (-), is defined on [0,L]. 

Now let y° and y 1 be in the same connected component of S. Let us construct 
in S a C 1 path (y(r, ■), w(r)), $J r $J 1, joining y° to y . For each z = 0, 1, set 

«i = /(0). 

Then with our previous notations: ?/(■) = y ai (-),i = 0, 1. Now set 

y(r, a;) = 2/(i_ T ) ao+TOl (x) and u{t) = y(r, L), 

where r G [0,1] and a; e [0, L]. By construction we have 

S(0,-)=2/°(-)> J/(1»0 = I/ 1 (0 and u(0) = «(l) = 0, 

and thus (y(r, -),m(t)) is a C 1 path in S connecting y° to j/ . 



(7.9) 



7.2.2. Stabilization procedure. This is the most technical part of the proof. 
Let e > 0. We set x G [0, L], 

z(t,x) := y{t,x)-y{et,x),te[0,l/e],xe[0,L], 
v(t) := u{t) -u{et),te [0,1 /e}. 

Then, from the definition of (y,u), we infer that z satisfies the initial-boundary 
problem 

c - f 1 - 

Zt = z xx + f'{y)z + z 2 / (1 - s)f"(y + sz)ds - ey T , 

(? ' 10) | z(t,0) = 0, z(t,L)=v{t), 

_ z(0,x) = 0. 
Now, in order to deal with a Dirichlet-type problem, we set 



(7.11) 



w(t, x) := z(t,x) 



>(t),te [0,l/e],a:G [0,L], 



and we suppose that the control v is differentiable. This leads to the equations 
(7.12) 



X X 

w t = w xx + f'{y)w + jf{y)v - —v' + r(e, t, x), 



w(t,0) = w{t,L) = 0, 
w(0,x) = ~v(0), 



r(e,t,x) = -sy T + (w + -vj / (1 - s)f" (y + s(w + -v)j ds 



where 

(7-13) „, v ., 

v Li ' J v -k 

and the next step is to prove that there exist e small enough and a pair (v,w) 
solution of (7.12) such that w{l/e,-) belongs to some arbitrary neighborhood of 
in i^Q-topology. To achieve this, one constructs an appropriate control function 
and a Lyapunov functional which stabilizes system (7.12) to 0. In fact, as we shall 
see, the control v will be chosen in H 1 ^, 1/e) such that v(0) = 0. 
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In order to motivate what follows, let us first notice that if the residual term 



and the control v were equal to zero, then (7.121 would reduce to 

wt = w xx + f'(y)w, 

w(t,0) = w(t,L) = 0. 
This suggests introducing the one-parameter family of linear operators 
(7.14) A(t) = A + f(y(r, -))Id, re [0,1], 

defined on H 2 (0,L) f~l Hq(0,L), Id denoting the identity map on L 2 (0,L). For 



every r G [0,1], A(t) has compact resolvent (see page 95) and A(t)* = A{t). 
Hence the eigenvalues of A T are real and the Hilbert space L 2 (0, L) has a complete 
orthonormal system of eigenfunctions for the operator A(t) (see, for example, [711 
Theoreme VI. 11, page 97] or [263 page 277]). 

Let (ej(r, -))j^i be a Hilbertian basis of L 2 (0, L) consisting of eigenfunctions of 
A{t) and let (^(t)),,^! denote the corresponding eigenvalues. Of course, for j ; Jj 1 
and each r G [0, 1], 

e J (T,)a o 1 (0 1 L)nC 2 ([0,I[). 

Note that, since the variable x is of dimension 1, the eigenvalues are simple (this is 
no longer true in higher dimension). We order these eigenvalues: for each r G [0, 1], 

— oo < . . . < A n (r) < . . . < Ai(t) and A„(r) — » — oo. 

n — >+oo 

A standard application of the min-max principle (see for instance |401l Theorem 
XIII. 1, pages 76-77]) shows that these eigenfunctions and eigenvalues are C 1 func- 
tions of r. We can define an integer n as the maximal number of eigenvalues taking 
at least a nonnegative value as r G [0, 1], i.e., there exists r\ > such that 

(7.15) Vt G [0, 1/e], Vfc > n, \ k {et) < -rj < 0. 

Remark 7.9. Note that the integer n can be arbitrarily large. For example, if 
f{y) = V 3 , then 

-p(0) -» +oo J => (n -♦ +oo) . 

We also set, for any r G [0, 1] and x G [0, L], 

x x 

a(r,x) = -f'{y{T,x)) and b{x) = --. 



In these notations, system (7.121 leads to 



(7.16) u> t (i, •) = A(et)w(t, ■) + a(et, -)v(t) + b(-)v'(t) + r(e, i, •)• 



Any solution w(t, ■) G H 2 (0,L) n -/7q(0,L) of (7.16) can be expanded as a series in 
the eigenfunctions ej(et, ■), convergent in Hq(0,L), 

oo 

w (^-) = ^ J w j( t ) e j( £t r)- 

3=1 

In fact, the w^'s depend on e and should be called, for example, Wj. For simplicity 
we omit the index e, and we shall also omit the index e for other functions. 

In what follows we are going to move, by means of an appropriate feedback 
control, the n first eigenvalues of the operator A(et), without moving the others, in 
order to make all eigenvalues negative. This pole-shifting process is the first part 
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of the stabilization procedure. It is related to the prior works [483j by Roberto 
Triggiani and [433 by Yoshiyuki Sakawa; see also 426, page 711] by David Russell. 
For any r G [0, 1], let tTi(t) denote the orthogonal projection onto the subspace 
of L 2 (0, L) spanned by ei(r, ■),..., e„(r, ■), and let 



(7.17) 



'*(*) = 7ri(£t)iw(V) = ^«jj-(t)ej(et,- 



It is clear that, for every r G [0,1], the operators 7Ti(t) and A(r) commute, and 
moreover, for every y G £ 2 (0, L), we have 



riWs/ = E (». ^ •)) i2(0 ,L) ¥r(T, •) + £ (p, ^f(r, •)) ej (r, •)• 



Hence, derivating (7.17l with respect to t, we get 



yV-(t)ej(«rf, •) = 7r 1 (et)w t (i, -) + e^ w(t, ■), ^(ei, ■) e^ei,-)- 



On the other hand, 



and thus (7.16[) yields 



A{et)w l {t) = S^\j{eb)wj{t)ej{sb, 



3=1 



VJ w'j(t)ej(et, ■) = y^ \j(st)wj(t)ej(£t, ■) + 7ri(£t)a(et, •)*>(*) 

(7-18) j =1 i= i 

+ 7n(et)&(-)v / (t)+r 1 (e,t,.), 



where 

n 

(7.19) r 1 (e,t,-) = 7T 1 (£i)r(e,i,-) + £l](y,^K- 



<9e, 



Ot 



e 3 (et,-). 



Let us give an upper bound for the residual term r . First, it is not difficult to 
check that there exists a constant C such that, if \v(t)\ and ||w(t, Olli^lUL) are l ess 
than 1, then the inequality 

lk(e > t,0|Uc ( o,£)<C(e + «(t) a + ||w(* > -)lli-(o 1 £)) 



holds, where r is defined by (7.13). Therefore we easily get 

ll^fo t, -)IU~(0,L) < d(£ + «(i) 2 + |K£, OIlloo^L))- 

Moreover, since Hq (0, L) is continuously imbedded in C ([0, L]), we can assert that 
there exists a constant C^ such that, if \v(t)\ and ||w(t, Ollzwo.L) are ^ ess than 1, 
then 

(7.20) Hr 1 ^, t, OlU-CCi) < G 2 (e + «(t) 2 + || W (t, OlHr^ci))- 
Now projecting (7.18 1 on each a, i = 1, . . . , n, one comes to 

(7.21) w'iit) = Xi(et)wi(t) + a t {et)v(t) + b t {et)v'{t) +rj(s,t), i = l,...,n, 



2:ill 
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where 



(7.22) 



Oi{et) = {a(et, -),ei(et, -))l2(o,l) = j I xf'(y( E t, x))e t (et, x)dx, 



bi(et) = (&(•), ei(et,-)) L i(p >L ) 



LJo 



xei(et, x)dx. 



The n equations (7.21 1 form a differential system controlled by v, v' . Set 

(7.23) a(t) = v'(t), 

and consider now v(t) as a state and a(t) as a control. Then the former finite- 
dimensional system may be rewritten as 



(7.24) 



w[ = AiiUi + aiv + b\OL + r\, 



_ w' n = \ n w n + a n v + b n a + r*. 
If we introduce the matrix notations 



X 1 (t) 



( v(t) \ 



\ »n(t) / 



Mr) 



/ 

ai(r) Ai(r) 



\ a n {r) 



Ri{e,t) 



\ 





An(r) / 



( ° \ 

ri(e,t) 



V <{e,t) ) 



Bi(r) 



( l \ 

h(r) 



\ b n (r) J 



then equations (7.24) yield the finite- dimensional linear control system 
(7.25) X[(t) =A r (et)X 1 {t) + B 1 (et)a{t) + Ri{e,t). 

Let us now prove the following lemma. 

Lemma 7.10. For each r £ [0,1], the pair (Ai(t),Bi(t)) satisfies the Kalman 



rank condition (Theorem 1.16 
(7.26) 



on page\yy, i.e., 
rank(B 1 {T) } A l {T)B l { T ),.. . , A^t) 71 ' 1 B 1 {t)) = n. 
Proof of Lemma |7.10 Let r G [0, 1] be fixed. We compute directly 



(7.27) det (B 1 ,A 1 B 1 ,...,A r l~ 1 B 1 ) = l[{a J +X J b J )VdM{X 1 ,...,\ n ), 

3=1 

where VdM(Ai, . . . , A„) is a Vandermonde determinant, and thus is never equal to 
zero since the A,-(r), i = 1, . . . , n, are distinct, for any r g [0, 1]. On the other hand, 
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using the fact that each e 3 -(r, ■) is an eigenfunction of A(t) and belongs to Hq (0, L), 
we compute 



aj(r) + \j(T)bj(T) 



x(f'(y(T,x))ej(T,x) - Xj(T)ej(T,x))dx 



d 2 e 

LJ X ^ T ^ dx 



(t,L). 



1 
L 

dx 



But this quantity is never equal to zero since ej(r,L) = and &j(t, •) is a non- 
trivial solution of a linear second-order scalar differential equation. Therefore the 



determinant (7.27 1 is never equal to zero and we are done. 



As we shall recall below (Theorem 10.1 



on page 



275 I , the Kalman rank con- 



dition (7.261 implies a pole-shifting property. To be more precise, from (7.261 



Theorem 10.1 on page 275 and Remark 10.5 on page 279 we get the following 
corollary. 

Corollary 7.11. For each r G [0, 1], there exist scalars fco( r )j • • • > k n (r) such 
that, if we let 

JflW^WT),,..,^)), 

then the matrix A\(t) + B\(t)K\(t) admits —1 as an eigenvalue with order n + 1. 
Moreover, the functions hi, i G {0, . . . ,n}, are of class C 1 on [0, T] and there- 
fore there exists a C 1 application r t— » P(t) on [0, 1], where P(t) is a (n+1) x (n+1) 
symmetric positive definite matrix, such that the identity 

(7.28) P(t) (Ai(r) + B 1 {t)K 1 [t)) + (^i(r) + S 1 (r)K 1 (r)) tr P(t) = -Id n+1 

holds for any r G [0, 1]. 

In fact, one has (see for example |309| page 198]), 



P(t) 



e t(A 1 (r)+B 1 (T)K 1 (r)y r e t(A 1 (T) + B 1 (r)K 1 (T)) dt _ 



We are now able to construct a control Lyapunov functional in order to stabilize 



system (7.16). Let c > be chosen later on. For any t G [0,1/e], v G R and 
w G H 2 (0,L)t\H^(0,L), we set 



1 



V(t,v,w) = cX^PietjX^t) - -(w,A(et)w) L 2 {0iL} , 



(7.29) 

where Xi(t) denotes the following column vector in M n+ : 



X x (t) :-- 



( V \ 

Wl {t) 



and 



Wi(t) := (w,ei(st,-)) L 2( 0tL y 
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In particular, we have 

1 OQ 

(7.30) V(t,v,w) = cX 1 {t)P{et)X 1 {t)- -^Aj(ef)^(i) 2 . 

Let Vi(t) := T^(£, v(£), w(t)). After some straightforward estimates (see [132 ), 
one gets the existence of a > and of p € (0, a] such that, for every e € (0,1] and 
for every t G [0, 1/e] such that Vi(t) ^ p, 

V((t) ^ ae 2 . 

Hence, since Vi(0) = 0, we get, if s € (0,p/cr], that 

Vi(£Ko-£, Vie [0, 1/e], 

and in particular, 



V'i 



< as. 



Coming back to definitions (7.9 1 and ( |7.11| , we have 

1 



(7.31) 



y\-) 



< 7 £ : 



ff!(0,L) 



where J/ (•) = y(l, ■) is the final target and 7 is a positive constant which does not 
depend on e € (0,p/<r]. This concludes the second step. 

7.2.3. Local controllability at the end-point. The last step in the proof 



of Theorem 7.3 consists of solving a local exact controllability result: from (7.31 1 



y(l/e, •) belongs to an arbitrarily small neighborhood of y 1 in the i/^-topology if e is 
small enough, and our aim is now to construct a trajectory t G [0, T] 1— > (q(t, •), u(t)) 
of the control system (7.5) for some time T > (for instance T = 1) such that 



<?(0, x) — yl-,x), q{T,x) = y 1 (x), x e (0,L). 

Existence of such a (q,u), with u 6 _fT x (0, i) satisfying u(0) = w(l/e), is given 
by [2431 Theorem 3.3], with y(t,x) = y 1 {x); see also [242] , Actually, in [243] . the 
function / is assumed to be globally Lipschitzian, but the local result one needs 
here readily follows from the proofs and the estimates contained in [243 . The key 



step for this controllability result is an observability inequality similar to (2.3981 
This completes the proof of Theorem |7.3| on page |225[ I 



Remark 7.12. One could also deduce Theorem 7.3 from [243, Theorem 3.3] 



and a straightforward compactness argument. But the method presented here leads 
to a control which can be easily implemented. See 132 1 for an example of numerical 
simulation. 



Remark 7.13. The previous method has also been applied in |133j for a semi- 
linear wave equation and in [437] by Michael Schmidt and Emmanuel Trelat for 
Couette flows. 
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7.2.4. Open problems. In this section we give open problems related to the 
previous results. We take 

f(y)-=y 3 - 

As mentioned above, it is one of the cases where, for numerous initial Cauchy data 
y € Hq(0,L), there are T such that there is no solution y € Yt of 

(7.32) y t - y xx = y 3 , {t, x) € (0, T) x (0, L), 
satisfying the initial condition 

(7.33) y(0,x) = y°(x),xe(0,L) 
and the Dirichlet boundary condition 

(7.34) y(t, 0) = y{t, L) = 0, t e (0, +oo). 

One may ask, if for this special nonlinearity, one can avoid the blow-up phenomenon 
with a control at x = 1, that is: 

Open Problem 7.14. Let y° e F^O.L) be such t hat y° (0) = and let T > 0. 
Does there exist y € Yt satisfying the heat equation (7.32), the initial condition 
(7.33) and the boundary condition 

(7.35) y{t,0) = 0, te(0,T)7 

Note that this seems to be a case where one cannot use the proof of [169 



Theorem 1.1] to get a negative answer to Open Problem 7.14 One could be even 



more "ambitious" and ask if the nonlinear heat equation (7.321 with a control at 
x = L is exactly controllable in an arbitrary time, i.e., ask the following question. 

Open Problem 7.15. Let T > 0. Let y° e H£(0,L) satisfy y°(0) = and let 



y G Yt be a solution of the nonlinear heat equation (7.32) satisfying 

y{t,0) = 0,te{0,T). 



Does there exist a solution y e Yt of the nonlinear heat equation (7.32) on (0,T) x 
(0, L) such that 

y(0,x) = y°(x),xe(0,L) } 

y(t,0) = 0,t€(0,T), 

y(T 1 x)=y(T,x),xe(0,L)? 



Let us recall (see Remark 7.7 1 that, if in (7.32) one replaces y by —y, the 



answer to this question is negative. 

One can also ask questions about the connectedness of S in higher dimension. 



Indeed, the proof of Theorem 7.3 given in |132j can be easily adapted to higher 
dimensions. Let us recall (see the proof of Proposition 3.1 in [132 ) that, for every 
nonempty bounded open interval f2 C K, 

S(fi) := {y e C 2 (n); -y" = y 3 } C C 2 (U) 

is a connected subset of C 2 (0). One may ask if the same holds in higher dimension. 
In particular: 

Open Problem 7.16. Let Q be a smooth bounded open set ofR 2 . Let 

6(0) := {y e C 2 (U); -Ay = y 3 } C C 2 (U). 

Ls 6(f2) a connected subset ofC 2 {Vt)? 



CHAPTER 



Power series expansion 



8.1. Description of the method 

We again explain first the method on the control system of finite dimension 

(8.1) x = f(x,u), 

where the state is x G R n and the control is u G K m . Here / is a function of class 
C°° on a neighborhood of (0, 0)gR"x R m and we assume that (0, 0) G 1" x W m 



is an equilibrium of the control system (8.1 1, i.e /(0,0) = 0. Let 
H := Span {A l Bu; u G R™, i G {0, . . . , n - 1}} 
with 

A 



g(0,0),£:= ^(0,0). 



controllable at (0, 0)€l"x R m (Theorem 3.8 



on page 



If H = W 1 , the linearized control system around (0, 0) is controllable (Theorem 1.16 
on page ^| and therefore the nonlinear control system (8.1) is small-time locally 



128 1. Let us look at the case 



where the dimension of H is n — 1. Let us make a (formal) power series expansion 



of the control system (8.1 1 in (x,u) around the constant trajectory t (-> (0,0) G 
1" x K m . We write 



x = y 1 + y 2 + 



U = V + V + 



The order 1 is given by (y , v ); the order 2 is given by (y 2 ,v 2 ) and so on. The 
dynamics of these different orders are given by 

(8.2) ^ = g (0)0 y + g ( o j0 y, 



Of 



Of 



IS 2 /, 



3) l/=^0V+^(MK + ^(0,0)(y\^) 



Ox 



On 



2dx 2 



and so on. Let e\ G H . Let T > 0. Let us assume that there are controls v± and 
v±, both in L°°((0, T); R m ), such that, if y± and J/ 2 are solutions of 



»i = g(o.°)«4 + ^(o,o)4, 



V±(0)=0, 



2:r> 
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fc = £(°.°te + §£(°.°>4 



___Z 

2dx 2 

d 2 f 



dxdu 



(o,o)(yi,v£) 

(0,0)(yi,4) 



id 2 / 

2<9u 2 



(o,o)(4,4), 



4(0) = o, 



then 



y±(T) = o, 

y 2 ± {T) = ±e 1 . 

Let (ei)i g {2....n} be a basis of H. By the definition of H and a classical result 
about the controllable part of a linear system (see e.g. [4581 Section 3.3]), there 
are (wi)i=2,...,n, ah in L°°(0,T) m , such that, if (xi)i=2,...,n are the solutions of 



0J_ 
Ox 



(0,0)xi 



then, for every % G {2, . . . , n}, 



Now let 



a*(0) 

Xi(T) = e 



5/ 

o, 



(0,0)ui 



£* 



i=i 



be a point in R". Let w 1 G L°°((0,T);R 

- If &i ^ 0, then w 1 := w^_ and w 2 

- If 6i < 0, then v 1 := wj!_ and v 2 
Then let u : (0, T) -> R m be defined by 



l ) be defined by the following 
_ „,2 



,,2 



u{t) := |6i| x/ V(t) + \bi\v 2 {t) + ^ 6iUi(t). 



Let x : [0, T] 



i" be the solution of 

x = f(x,u(t)), x(0) 
Then one has, as b — > 0, 
(8.4) x(T) = 6 + o(6). 



Hence, using the Brouwer fixed-point theorem (see Theorem B.15 



on page 



390 I and 



standard estimates on ordinary differential equations, one gets the local controlla- 
bility of x = f(x, u) (around (0, 0) G E n x R m ) in time T, that is, for every e > 0, 
there exists rj > such that, for every (a, 6) G R n X R" with \a\ < r] and |6| < r;, 
there exists a trajectory (x,u) : [0,T] — > R n x 
that 

x(0) = a, x(T) = b, 
|u(t)|<e,te(0,T). 



of the control system (8.1 ) such 



(One can also get this local controllability result from (8.4 I by using degree theory 
as in the proof of Theorem 11.26 on page 301 ) 
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This method is classical to study the local controllability of control systems 
in finite dimension. In fact, more subtle tools have been introduced: for example 
different scalings on the components of the control and of the state as well as scaling 
on time. Furthermore, the case where the codimension of H is strictly larger than 
1 has been considered; see e.g. [U [Ml M\ [Ml I226J I228J [270], [468], I469J 1482] 
and the references therein. 

In the next section we apply this method to a partial differential equation, 
namely the Korteweg-de Vries equation. In fact, for this equation, an expansion to 
order 2 is not sufficient: we obtain the local controllability by means of an expansion 
to order 3. 

8.2. Application to a Korteweg-de Vries equation 

Let L > 0. Let us consider, as in Section [4. 1[ the following Korteweg-de Vries 
(KdV) control system 

(8.5) Vt + Vx + Vxxx + yyx = 0, t G (0,T), x G (0,L), 

(8.6) y(t, 0) = y(t, L) = 0, y x (t, L) = u(t), t G (0, T), 

where, at time t G [0, T], the control is u(t) G K and the state is y(t, ■) : (0, L) — * K. 
Let us recall that the well-posedness of the Cauchy problem 

yt + yx + yxxx + yyx = 0, t e (o,r), x e (o,L), 

y(t, 0) = y(t, L) = 0, y x (t, L) = u{t), t G (0, T), 

y(0,-)=y°(x), 

for u G L 2 (0, T), has been established in Section 
on page 



tion 



4.1 



160 and Theorem 4.2 



on page 



4.1.1 



161) 



(see, in particular, Defini- 



We are interested in the local controllability of the control system 
around the equilibrium (j/ e , u e ) := (0, 0). Let us recall (see Theorem 4.3 
that this local controllability holds if 



5|-g6| 



on page 



1611 



(8.7) 



L i H := { 2tt 



j 2 + P+ jl 



;j6N\{0},IeN\{0} 



The aim of this section is to study the local exact controllability around the equi- 
librium (y ej u e ) := (0,0) G L 2 (0,L) x R of the nonlinear KdV equation when 
L = 2kir G J\f (take j = I = k in (4.12 l). The main theorem is the following one. 



Theorem 8.1 ([122] Theorem 2]). Let T > and k G N \ {0}. Let us assume 
that 

(8.8) (f + l 2 + jl = 3fc 2 and (j, I) G (N \ {0}) 2 ) =► (j = I = k) . 

Let L = 2kn. (Thus, in particular, L G M .) Then there exist C > and r\ > 
such that for any y°, y 1 G L 2 (0, L), with \\y°\\i,2(p t L) < r i and II y 1 II z, 2 (o,£) < r i, 
there exist 

yeC°([0,T}-L 2 (0,L))nL 2 ((0,T);H 1 (0,L)) 
and u G L 2 (0,T) satisfying (8.5)-(8.6), such that 

(8.9) - fn ^--° 
(8.10) 
(8.11) 



y 



2/(0,0 
y(T,-) = y\ 

IklU^o^^cdl^lu^o^ + lly 1 !!^^)) 1 / 3 . 
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Remark 8.2. Assumption (8.8 1 holds for k ^ 6 and for an infinite number 
of positive integers (see Proposition 8.3 below). However, there are also infinitely 
many positive integers k such that (8.8 1 does not hold: note that 



x + xy + y = 3z 



if 



x := a 2 + Aab + b 2 , y := a 2 - 2ab - 2b 2 , z := a 2 + b 2 + ab, 
and that x > 0, y > and z > if a > and 

i _i_ AT 

(-2 + \/3)a <b< — a. 



Unfortunately, we have forgotten assumption (8.8) in 122, Theorem 2]. This is a 
mistake: the proof of [122, Theorem 2] requires (8.8 1. 



Proposition 8.3. There are infinitely many positive integers k satisfying (8.8). 



Proof of Proposition 8.3 Let k > 2 be a prime integer. Let us assume that 
there are positive integers x and y such that 

(8.12) (x,y)^(k,k), 

(8.13) x 2 + xy + y 2 = 3k 2 . 
Let us prove that 

(8.14) —3 is a square in Z/fcZ, 

that is, there exists j)6Z such that 3 + p 2 is divisible by k. Indeed, from (8.131, 
one gets 

(8.15) 

(8.16) 

Note that 

(8.17) x t^O (mod k). 
Indeed, let us assume that 

(8.18) z = 0(modfc). 



2>xy = (x — y) (mod k), 
xy = (x + y) (mod k). 



From (8.161 and (8.181, one gets that 

x + y = (mod k), 



which, together with (8.181, implies that 
(8.19) 



x = (mod k), y = (mod k). 



However, (8.121 and (8.19) implies that 



x 2 + xy + y 2 > 3fc 2 , 



in contradiction with (8.13). Hence (8.17l holds. Similarly, 
(8.20) y t^O (mod k). 



From ( |8.16| , ( |8.17[ ) and ( |8.20| , one gets that 
(8.21) x + y /0 (mod k). 
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:>::'> 



Finally, from fl8.15| ), ( |8.16| ) and ( |8.21[ ), we have 



((x + j/)-^^-?/)) 2 inZ/ifcZ, 



which shows (8.14l 



Let us prove, following [444, 445 1, that the set of prime integers k not satisfying 
condition (8.14) is infinite, and more precisely, its density inside the set of prime 



integers is equal to 1/2. 

First of all, let us introduce the Legendre symbol (f ), where k is a prime and 
x G Z is an integer not divisible by k. We put 



(I) 



1, if x is a square modulo k, 

— 1, if a; is not a square modulo k. 



Note that 
(8.22) 



k ) \k) \k, 

for x, y G Z coprime to k. Indeed, if one of x or y is a square modulo k, this is 
obvious. Otherwise, note that the subgroup G C (Z/fcZ)* consisting of squares has 
the property that the quotient (Z/£;Z)*/G has order 2, because G is the image of 
the group morphism x t— > x 2 from (Z/fcZ)* into itself, and this group morphism has 
for kernel the order 2 group {1,-1}. Thus if neither x nor y is a square modulo k, 
the classes of x and y modulo G are equal, and their product modulo k belongs to 
G. 

If p > 2 and fc > 2 are two distinct prime integers, the quadratic reciprocity 
law due to Gauss (see, e.g., [444, Theorem 6, Chapter I, page 7] or [445, Theoreme 
6, Chapitre I, page 16]) says the following: 

'k s 



(8.23) 
where 



(I) 



(-1) 



e(p)e{k) 



e(p) 
e{p) 



Up 
if p 



1 (mod 4), 
-1 (mod 4). 



Let us now prove the following lemma. 

Lemma 8.4. Let k > 2 be a prime integer. One has 

-L 



.24) 



(-1) 



e(k) 



Proof of Lemma 8.4 Let us consider the multiplicative group (Z/fcZ)*. The 
nonzero squares in Z/fcZ are exactly the elements of the subgroup G C (Z/fcZ)* 



defined as the image of the group morphism x 



This group G has cardinality 



(k — l)/2. Indeed, the kernel of the morphism above consists of the two elements 
1,-1, which are the only solutions of the polynomial equation x 2 = 1 in Z/fcZ. 

Note that —1 is a square modulo k if and only if —1 G G, and that if this is 
the case, multiplication by —1 induces a bijection of G. Now we introduce 

a := n g. 

sec 
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Then, if — 1 s G, we have 



(-1) — a 



m-9) 

g&G 



and thus (— 1) 



1, i.e., e(k) = 0. Hence (8.24 1 holds in this case. 



If, on the other hand, —1 is not a square in Z/fcZ, we find that multiplication 
by —1 induces a bijection between G and its complement, denoted C G. Thus we 
get in this case 

(-i)^a=n (-<?)= n ^ 

g£G ge-G 

Observe to conclude that in (Z/fcZ)* we have the relation 

(8.25) || <i = -i. 



which implies that 



n 9 

ge(Z/kZ)' 



n 9 

ge(Z/kZ)*\G 



U9 

sec 



and hence (-l)^ fc l ^ 2 = — 1. 



Thus, in the second case, we get (— l)( fc_1 " 2 a = 
Therefore e(k) = 1 and (8.24) holds in this case also. 

Relation (8.251 is proved by noticing that in this product, we find the terms 
1, —1, and that all the other terms g £ {1,-1} appear in pairs {g, g^ 1 }, with 
g ^ g^ 1 . This concludes the proof of Lemma 8.4 ■ 



have 
(8.26) 



We return to the proof of Proposition 
-p\ I k 



3 From (8.24 I, (8.23) and (8.22), we 



k 



(-1) 



(e(p) + l)e(fe) 



Let us apply this to p = 3 and k > 3 (we recall that k is a prime integer) . We have 
e(3) = 1. By definition 

-3 N 
~k 



1 



if and only if —3 is a square modulo k. By (8.26), this is equivalent to 



1. 



that is, k = 1 (mod 3). 

In conclusion, if k > 3 is a prime integer such that k 
k satisfies 



-1 (mod 3), then 



.81. As there are two possible nonzero congruences modulo 3, the 



Dirichlet density theorem (see, e.g., [4441 Theorem 2, Chapter VI, page 73] or 
|445| Theoreme 2, Chapitre VI, page 122]) now says that the set of prime integers 
k such that k = — 1 (mod 3) has density equal to 1/2 in the set of prime integers. 
In particular, there are infinitely many prime integers k such that k = — 1 (mod 3). 
This concludes the proof of Proposition |8.3| ■ 
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Proof of Theorem 18. 11 We assume that L = 2kir 



The linearized con- 
6 1 around (y e ,u e ) := (0,0) £ 



trol system of the nonlinear control system (8.5 1- 
L 2 (0,2fc7r) xEis 

' yt + Vx + Vxxx = 0, t e (0,T),x€ (0,2/ctt), 
y(t,0) = y{t,2kn) = 0, y x (t,2kn) = 0,t€ (0,T). 

this linear control 



(KdVL) 



As we have seen previously (see Theorem 2.25 



on page 



421 



system is not controllable. Indeed, for every solution 

(y, u) e C°([0, T]; L 2 (0, 2kir)) x L 2 (0, T) 
of (KdVL), one has, using simple integrations by parts and density arguments (see 



also (2.1811), that 



_d_ 
d7 



2/w, 



(1 — cos(x))ydx = 0. 



To prove that the nonlinear term yy x gives the local controllability, a first 
idea could be to use the exact controllability of the linearized equation around 
nontrivial stationary solutions proved by Emmanuelle Crepeau in [136] and to 
apply the method we have used to get the local controllability of the 1-D tank 
(that is, use the return method together with quasi-static deformations; see Section 
6.3 1 . However, with this method, we could only obtain the local exact controllability 
in large time. In order to prove Theorem |8.1[ we use a different strategy that we 
have briefly described in the above section (Section 8.1l. 



We first point out that, in this theorem, we may assume that y° = 0: this 
follows easily from the invariance of the control system (8.5)-(8.6) by the change of 
variables r = T — t, £ = 2kn — x (and a suitable change for the control). Then we 
use the following result for the linear control system, due to Lionel Rosier. 



Theorem 8.5 ( [407] ). Let T > and 



.27) 



f p2kir 

H:=lyeL 2 (0,2kn),J ,/(! 



cos(x))dx = 



Let us assume that k € N\ {0} is such that (8.8) holds. Then, for every (y®,y l ) G 
H x H , there exist 

ye C ([0,T];L 2 (0,2fc7r))nL 2 ((0,T);iy 1 (0,2fc7r)), u£ L 2 (0,T), 

satisfying (KdVL), such that y(0, ■) = y° and y(T, •) = y . 

Next, as we are going to see, the nonlinear term yy x allows us to "move" in the 
two (oriented) directions ±(1 — cos(a;)) which are missed by the linearized control 
system (KdVL). Finally, we briefly sketch how to derive Theorem 



.1 



from these 

motions by means of a fixed-point theorem. Let us now explain how the nonlinear 
term yy x allows us to "move" in the two (oriented) directions ±(1 — cos(x)). Let 
L > 0. We first recall some properties about the following linear KdV Cauchy 
problem 

(8.28) y t + y x + y xxx = /, 



.29) 
.30) 
.31) 



y(t,0)=y(t,L) = 0, 
y x (t,L) = h(t), 

y(To,x) = y°(x). 
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It follows from what we have seen in Section 4.1.2 that, for every y° £ L 2 (0 : L), for 



every u € L 2 (T ,Ti) and for every / € L 1 ((T ,T 1 ); L 2 (0, L)), there exists a unique 



solution y G C ([ r ,T i]; L 2 (0,L )) of ( |8.28| to ( |8.3l| (see page [162] for the definition 
of a solution of (8.28) to (8.31)). Let us also recall, as we have seen in the same 
section, that 

y e B To , Tl := C°([T , 21]; L 2 (0, L)) n L 2 ((T , 21); ^(0, L)); 



see the paper [407] by Lionel Rosier for complete details. 
In |122j we proved the following proposition. 



Proposition 8.6. Let T > and let k e N \ {0}, satisfying (8.8). Then 
there exists (u±,v±,w±) in L 2 (0,T) 3 such that, if a±, (3±, j± are respectively the 
solutions of 



(8.32) 
(8.33) 
(8.34) 
(8.35) 



u±t + a± x + a± xxx = 0, 

a±(t,0) =a±{t 1 2kTr) = 

a± x (t, 2kir) = u ± (t), 

a±(0,x) = 0, 



.36) 
.37) 
.38) 
.39) 



P±t + P± x + P±x XX = -a±a± x , 

[3±(t,0)=l3 ± (t,2kn) = 0, 

f3 ±x {t,2kir) = v ± {t), 

P±(0,x)=0, 



(8.40) 

(8.41) 

(8.42) 

(8.43) 

then 

(8.44) 



l±t + l± x + l± xxx = —(a±/3±) x , 
7±(*»0)=7±(*,2*tt) = 0, 

-y ±x (t,2kir) = w±(t), 
J±{0,x)=0, 

a±{T,x) = 0, (3±(T,x) = and j±(T,x) = ±(1 — cos(x)). 



Remark 8.7. It would have been quite natural to look for the existence of 
(u±,v±) in L 2 (0,T) 2 such that, if a±, (3± are respectively the solutions of 



<x±t + a± x + a± a 



0. 



a±(t,0) =a ± {t,2kn) = 0, 

a± x (t, 2kir) = u±{t), 

a±(0,a;) = 0, 

P±t + P± x + P± xxx = -u±a± x , 

[3±(t,0)=l3 ± (t,2kn) = 0, 

p ±x {t,2kir) = v ± {t), 
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2 Li 



then 



a±(T, x) = and /3±(T, x) = ±(1 — cos(a;)). 



The existence of such (u±, v±) would also have implied Theorem 8.1 Unfortunately. 



as it is proved in |122j . such (u±,v±) does not exist. At this point we see that, as 
mentioned earlier on page |237} an expansion to order 2 is not sufficient: this is the 
expansion to order 3 which gives the local controllability. 

I] from Proposition |8.6| As 
6 1 by the change 



Let us now explain how to deduce Theorem 
pointed out above, by the invariance of the control system (8.5 I 
of variables r = T '—t, £ = 2kir — x (together with a suitable change for the control), 
we can content ourselves to prove that, for every T > 0, there exists r[ > such 



that, for every y 1 G L 2 (0, 2kir) with 
such that the solution y of 



\V ||i 2 (0,2fc7r) 



Sj r[, there exists u G L (0,T) 



(8.45) 
(8.46) 
(8.47) 
(8.48) 

satisfies y(T, 



Vt + Vx + Vxxx + VVx = 0, 

y(t,0)=p(t,2fc7r) = 0, 

y x (t,2kw) = u(t), 

y(0,x)=0, 



y 1 . Of course, by "y is a solution of (8.45), (8.461, (8.47) and 



(8.48) 



we mean that y is in Bqt and is the solution of 

Vt+Vx+ Vxxx = f, 

y(t,0) = y(t,2kn) = 0, 

y x (t,2kw) = u(t), 

y(0,x)=0, 

with / := — yy x (note that, if y is in Bqt, then yy x G L 1 ((0, T); L 2 (0, 2fc7r))). It 
is proved in [122J that, for a given u € L 2 (0,T), there exists at most one solution 
of (|8.45 ), (8.46), (8.471 and (8.481, and that such a solution exists if ||m||l2(o,t) is 



small enough (the smallness depending on T and k) 

on page 



By (the proof of) Theorem 8.5 



241 and Remark 2.33 



also [4071 Remark 3.10]), there exists a continuous linear map T, 
(8.49) T:heHc L 2 (0, 2kir) t-» T(h) € L 2 {0, T), 

such that the solution of the linear system 



on page 



48 (see 



Vt + Vx + Vx 



0. 



y(t,0)=y(t ) 2fc7r) = 0, 

y x (t,2kTr)=T(h)(t), 
y(0,x)=0, 

satisfies y(T,x) = h(x). (One can take for V the control obtained by means of 
HUM; see [4071 Remark 3.10].) 

Let y 1 G L 2 (0, 2kir) be such that ||j/ 1 ||z, 2 (o,2fc7r) ^ r, r > small enough so that 
the maps below are well defined in a neighborhood of 0. Let 7^i denote the map, 



T y i 



L 2 (0,2kir) 
z 



L 2 (0,2/br) 
z + ^-F{G{z)), 
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with 



L 2 (0,T) 
u 



L 2 (0,2kir) 



45), (8.461 



where y is the solution of 

G : L 2 (0,2/br 
is defined as follows. We write 



.471 and 
^L 2 (0,T) 



48 I , and where 



z = Vh{z) + p{z)(l - cos(x)) 



with 



2/wi 



V H (z)(l - cos(x))dx = 0. 



(In other words, Vh(z) is the orthogonal projection of z on H for the L 2 (0, 2kir)- 
scalar product.) Then: 

1. If p(z) ^ 0, G{z) := T{V H (z)) + p 1 / 3 (z)u+ + p 2 l 3 {z)v+ + p(z)w+. 

2. If p(z) s: 0, G(z) := T(V H (z)) + \p(z)\ l J 3 U- + \p(z)\ 2 / 3 v- + \p(z)\w- 



.6 



(The functions u± , v± and w± have already been defined in Proposition 

Clearly, each fixed point z* of T y i satisfies F(G{z*)) = y , and the control 
u = G(z*) is a solution to our problem. In order to prove the existence of a fixed 
point to T y i, at least if ||y 1 ||L 2 (o,2fc7r) is small enough, one first proves the following 
estimate (see |122j for the proof): There exist K > and R > such that 

for every z£i (0, 2kir) with 



\\%z\\ L 2 {0i 2k^) < ^IMlL2 (0i2fe7r) for every z £ L z (0,2ki:) with ||-?||i2( 0) 2fc7r) < R - 

Then, using the continuity of T y i(z) with respect to y 1 and z, we could conclude 
to the existence of a fixed point to T y i at least if ||y 1 ||L 2 (o,2fe7r) were small enough 
and if we were in finite dimension or had, more generally, a suitable compactness 
property. Unfortunately, we do not have this compactness property. So we proceed 
in a different manner. We use the Banach fixed-point theorem for the part in H 
and the intermediate value theorem in H . (If H had dimension in N \ {0, 1}, 
we would have used the Brouwer fixed-point theorem instead of the intermediate 
value theorem: In dimension 1 the Brouwer fixed-point theorem reduces to the 
intermediate value theorem.) See |122j for the detailed proofs. ■ 

8.2.1. Open problems. For the other critical lengths, the situation is more 
complicated: there are now more noncontrollable (oriented) directions of the lin- 
earized control system around (0,0). It is natural to ask if Theorem 8.1 also holds 
for all the other critical lengths, that is, to ask if the answer to the following open 
problem is positive. 



Open Problem 8.< 
such that, for every y°, 



Let L € J\f and T > 0. Do there exist C > and r > 



y 1 e L 2 {0,L) with ||i/°||i»(o,L) < r and \\y 1 \\ L 2 (0tL) 



< r, 



there exist y £ C°([0, T]; L 2 ( 0, L)) nL 2 (( 0, T) ; 7^(0, L)) undue L 2 {0,T) satisfying 
$H)\)-$ni\! such that fislfy , \8.1(ty and {8.11\ hold? 



Remark 8.9. One could also ask the same question by requiring a weaker 
smallness condition than (8.11 ) or even simply by omitting this condition. In fact, 



our intuition is that for L £ 2irN, a power series expansion to the order 2 could be 
sufficient and therefore 1/3 could be replaced by 1/2 for these lengths. It is also 
possible that the local controllability holds only for large enough time T (that is, 
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one should replace "Let L > and T > 0. Do there exist C > and r > ..." by 



"Let L > 0. Do there exist T > 0, C > and r > ..." in Open Problem [8^. Note 
that this is indeed the case for the nonlinear Schrodinger equation (see Theorem 9.8 
on page 251 and Section 9.3 1. Eduardo Cerpa obtained in [85 a positive answer 



to Open problem 8.8 if there are exactly 4 uncontrollable (oriented) directions for 



the linearized control system around the equilibrium (y e , u e ) := (0, 0) (instead of 2 



for L G 2ttN satisfying (8.8 1, namely 1 — cos(x) and cos(a;) — 1) if T > is large 



enough. His proof also relies on the power series expansion method. In this case a 



power series expansion to order 2 is indeed sufficient. Note that, using Remark 8.2 



on page 238 one can prove that, for every n G N, there are infinitely many L's 
such that there are at least n uncontrollable (oriented) directions for the linearized 
control system around the equilibrium [y e , u e ) := (0, 0) G £ 2 (0, L) x K. 

All the previous results are local controllability results. Concerning global 
controllability results, one has the following one due to Lionel Rosier |409] . 

Theorem 8.10. Let L > 0. For every y° G L 2 (0,L), for every y 1 G L 2 (0,L), 
there exist T > and y G C°([0,T]; L 2 (0, L)) l~l L 2 ((0,T); H X {Q,L)) satisfying 

yt + y x + yxxx + yy x = o in v'{{0, T) x (o, L)) 

such that y(0, •) = y and y(T, •) = y . 
Note that in this theorem 

1. One does not require y(t,0) = y(t,L) = 0, 

2. A priori the time T depends on y° and y 1 . 

It is natural to wonder if one can remove these restrictions. For example, one may 
ask: 

Open Problem 8.11. Let L > 0, T > 0, y° G i 2 (0,L) and y 1 e L 2 (0,L). Do 
there exist y G C°([0, T]; L 2 (0,L))nL 2 ((0,T); H l (0, L)) and u G L 2 (0,T) satisfying 



f<g.5|)-fg.6|) such that y(0, ■) = y° and y(T : ■) = y 1 ? 

If one does not care about T (i.e., we allow T to be as large as we want, 
depending on y° and y 1 ), a classical way to attack this open problem is the following 
one (this is the method which is already used by Lionel Rosier to prove Theorem 



8.101 



Step 1 . Use the reversibility with respect to time of the equation to show that one 
may assume that y 1 = 0. (In fact, this part holds even if one deals with 
the case where one wants T > to be small.) 

Step 2. Use a suitable stabilizing feedback to go from y° into a given neighborhood 
of 0. 

Step 3. Conclude by using a suitable local controllability around (y,u) := 0. 

Step 1 indeed holds (perform the change of variables (t,x) := (T — t, L — x)). Let 



us assume that L g' AT or L = 2nk with k G N\ {0} satisfying (8.8 ). Then, applying 
Theorem |4. 3 1 or Theorem |8.1[ one can perform Step 3. Concerning Step 2, a natural 
choice is to consider the simpler feedback, namely y x (t, L) := 0, which leads to the 
following Cauchy problem: 

(8.50) y t + y x + yxxx + yy x = o,te (0, +oo), x G (0, L), 

(8.51) j/(t, 0) = y(t, L) = y x {t, L) = 0, t G (0, +oo), 

(8.52) y(0,x) = y°(x),xe(0,L). 



2i(i 



i. POWER SERIES EXPANSION 



where y° is given in L 2 (0,L) and one requires 

(8.53) yeC([0,+oo);L 2 (0,L))nLf oc ([0,+oo);iT 1 (0,L)). 

Straightforward computations shows that, at least if y is smooth enough, 

d 

d7 



\y(t,x)\ 2 dx = -\y x (t,0)f 



Hence one can expect that the Cauchy problem ( 8.50 )-( 8.51 1-( 8.52 I has a solution 



This turns out to be true: It has been proved by Gustavo Perla Menzala, Carlos 



Vasconcellos and Enrique Zuazua in [382j that the the Cauchy problem (8.50) 



(8.51 1-( 8.52 I has one and only one solution. (See also [122, Appendix A].) However, 



it is still not known (even for L $ J\f) if the following open problem has a positive 
answer. 



Open Problem 

.54) 



.12. 



Does one have, for every y° G L 2 (0,L), 
lim / \y(t,x)\ 2 dt = 0? 



There are available results showing that (8.54 I holds if there is some interior 



damping, more precisely with (8.50) replaced by 

Vt + Vx + Vxxx + VVx + a(x)y = 0, t G (0, +oo), x e (0, L), 

where a G L°°(0, L) is such that 

a(x) Ss 0, x G (0,L), 

the support of a has a nonempty interior. 

These results are in |382j by Gustavo Perla Menzala, Carlos Vasconcellos and 
Enrique Zuazua, in [380 by Pazoto, and in [413 by Lionel Rosier and Bing-Yu 
Zhang. 



CHAPTER 9 

Previous methods applied to a Schrodinger 

equation 

9.1. Controllability and uncontrollability results 

In this chapter we consider a control system which is related to the one- 



dimensional Schrodinger control system (4.85 l-(4.86l considered in Section 4.2.2 
Let I = (— 1, 1). We consider the Schrodinger control system 

(9.1) ipt = ii>xx + iu(t)xtp, (t, x) G (0, T) x /, 

(9.2) v(*,-i) = V'(t,i)=o,*€(o,r) > 

(9.3) S(t) = «(<), D{t) = S{t), t e (0,T). 

This is a control system, where, at time t G [0,T], 

- the state is (ip(t, •), S(t),D(t)) G L 2 (I;C) x R x R with / T \Tp(t,x)\ 2 dx = 1, 

- the control is u(t) G R. 



Compared to the one-dimensional Schrodinger control system ( 4.85 l-(4.86 I consid- 
ered in Section |4. 2. 2| we have only added the variables 5 and D. This system has 
been introduced by Pierre Rouchon in |417j . It models a nonrelativistic charged 
particle in a 1-D moving infinite square potential well. At time t, ip(t, •) is the wave 
function of the particle in a frame attached to the potential well, S(t) is the speed 
of the potential well and D(t) is the displacement of the potential well. The control 
uit) is the acceleration of the potential well at time t. (For other related control 
models in quantum chemistry, let us mention the paper [3061 by Claude Le Bris 
and the references therein.) We want to control at the same time the wave function 
ip, the speed S and the position D of the potential well. Let us first recall some 
important trajectories of the above control system when the control is 0. Let 

(9.4) r/, n (t, x) := Vn {x)e^ x -\n G N \ {0}. 
Here 

(9.5) A„ := (mr)74 
are the eigenvalues of the operator A defined on 

D(A) := H 2 n H^{I;C) 

by 

Aip := -ip", 

and the functions tp n are the associated eigenvectors: 

(9.6) fn(x) := sin(n7ra;/2), n G N \ {0}, if n is even, 

(9.7) <£n{x) := cos(njrx/2), n G N \ {0}, if n is odd. 
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Let us recall that 

§:={<^eL 2 (/;C);|M| L2(/;C 
and let us also introduce the following notation: 

H 7 a) (I; C) := y G H 7 (I; C); ^ 2k \-l) = ^ 2k \l) = for k = 0, 1,2, 3}. 
With these notations, one has the following result, proved in 



Theorem 9.1. For every n G N\ {0}, there exists r\ n > such that, for every 
n Q ,n f GN\{0} and for every «, S°, D°), (if) 1 , S 1 , D 1 ) G (§ n # ( 7 0) (/; Q) xlxl 
with 

(9-8) IIV' -¥'nollHT {/ . C) + |S | + |r> |<^ 0) 

(9-9) IIV' 1 - (Mjjt (/ .q + I5 1 ! + I.D 1 ! < ry n/ , 

i/iere errisi a time T > and ( , 4>,S,D,u) such that 



(9.10) 
(9.11) 
(9.12) 
(9.13) 
(9.14) 
(9.15) 



VeC°([0,T];iT 2 ni7 1 (/;C))nC 1 ([0,T];L 2 (/;C)), 
SgC^O.T]), fleC 2 ([0,T]), 



(9.11, (9.2) and (9.3l ftota. 



(V(0),5(0),^(0)) = (^ ,^ ,^ ), 
MT),S(T),D(T)) = (fl, 1 ,S\D 1 ). 
Remark 9.2. Using standard methods, one can check that tp ls m fact niore 



regular than stated by (9.101: One has 

(9.16) ^eC ([0,T};H 3 (I;C)nH^I;C))nC l ([0,T};H 1 (I;C)). 

Let us emphasize that, if one does not care about S and D and if (no,rif) = 
(1, 1), then Theorem |9.1 1 is due to Karine Beauchard [40] , 
From Theorem |9.1[ we have the following corollary. 

Corollary 9.3. For every n ,rif G N\{0}, there exist T > and (ip,S,D,u) 
satisfying {9J(fy-{9Jlty-{9Jty-$Uify such that 



(V>(0),S(0),£>(0)) = (p Bo ,0 ) 0), 
(!l>(T),S(T),D(T)) = (<p nf ,0,0). 

Note that, as pointed out by Gabriel Turinici in |488j . it follows from a general 
uncontrollability theorem |281 Theorem 3.6] due to John Ball, Jerrold Marsden 
and Marshall Slemrod that Theorem 9.1 does not hold if one replaces Hj„Jl; C) by 
H 2 {I;C)r\H^{I;C) and H^{0,T) by 2/(0, T); see also Remark" 



2.14 



on page 



34 



In 



the framework of Hilbert spaces, the general uncontrollability theorem [28, Theo- 
rem 3.6] is the following one. 

Theorem 9.4. Let H be a Hilbert space and let A be the infinitesimal generator 
of a strongly continuous semigroup S(t), t G [0, +oo), of continuous linear operators 
on H. Let B : H —> H be a linear bounded operator. Let x° G H and let TZ(x°) 
be the set of x 1 G H such that there exist T, r > and u G L r (0,T) such that the 
solution x G C°([0,T];H) of 

(9.17) x = Ax + u(t)Bx,x(0) = x°, 
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21!) 



satisfies x(T) = x . Then 1Z(x°) is contained in a countable union of compact 
subsets of H . In particular, if H is of infinite dimension, ~R,{x ) has an empty 
interior. 

The definition of "strongly continuous semigroup S(t), t € [0,+oo), of continu- 
ous linear operators" is given in Definition | A . 5 1 and Definition | A . 6 1 on page |374} For 
the meaning of U A is the infinitesimal generator of a strongly continuous semigroup 
S(t), t G [0,+oo) of continuous linear operators", see Definition A. 9 on page 



375 



By "x : [0,T] ^ # is a solution of ( |9.17| )", one means that x G C°([0,T];H) 
and satisfies 

(9.18) x(t) = S(t)x° + I u(s)S{t - s)Bx(s)ds, Vt G [0,T]. 

Jo 



For the existence and uniqueness of solutions to the Cauchy problem (9.17l, see, 
Theorem 2.5]. 



for example, 

Proof of Theorem |9.4[ Let n G N. Let K n be the set of b G H such that 
for some u G L 1+( - 1 ' n '(0, n) satisfying 

(9.19) IMlLi+(i/»)(o,n) < n, 

and for some r G [0, n], one has x(r) = b, where x is the solution of 

(9.20) x = Ax + u(t)Bx(t), x(0) =x°. 
In order to prove Theorem |9.4| it suffices to check that 

(9.21) K n is a compact subset of H. 



?k k 



S N be a sequence of elements in K n . For k G N, let 



Let us prove (9.21). Let 

u k G L 1+ ( 1 /«-)(o, n ) such that 

(9-22) IKILi+(i/«)(o,„) < n, 

and Tfc G [0, n] such that Xfe(rfe) = 6^, where x k is the solution of 

x k = Ax k + u k (t)Bx k , ccfc(0) = x°. 

In other words, 

(9.23) x k (t) = S(t)x° + / u k (s)S(t- s)Bx k (s)ds, Vt G [0,n]. 

Without loss of generality, we m ay assume that, for some r G [0, n] and some 
u g L 1 +( 1 /«)(o,n) satisfying (|9.19|, 

(9.24) 

(9.25) Ufc — // weakly ID L ' 'il!.;/! ;)- ..V X. 



Tfc — > t as fc — » +CXD, 
m weakly in L 1+(1/n) (0, n) as fc -> +c 



Let a: G C°([0, n\; H) be the solution of (9.20 I associated to this control u. In other 
words, one has (9.181 for T := n. It suffices to check that 

(9.26) x k {Tk) — » x(r) as A: — > +oo. 
Let y fe G C°([0,n];iJ) be defined by 

(9.27) y k (t) :=x k (t)-x{t) 7 \/te [0,n]. 

Since t^. — > r as fc — > +oo , in order to prove (9.26), it suffices to check that 
(9-28) ||s/*||c°([o,n];ff) 



as k — » ex). 
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From fl9.18| , fl9.23[ ) and fl9.27| , we get 
(9.29) 

y k (t) = j (u k (s) - u(s))S(t - s)Bx(s)ds + f u k {s)S{t - s)By k (s)ds, Vf g [0, n] 

Let 

(9.30) p k := Max 

Let us check that 
(9.31) 

Let t k G [0,n] be such that 



(■Ufe(s) — u(s))S(t — s)Bx(s)ds 



lim p fc = 0. 

k — >+oo 



; t G [0, 



if 



(9.32) 



Pk 



(ufe(s) — u(s))S(t k — s)Bx(s)ds 



H 



Without loss of generality, we may assume that there exists t g [0, n] such that 

(9.33) t k — > £ as fc — > +oo. 

Let us extend S : [0, +oo) — y C(H; H) to a map 5 : K — •» £(7? ; -ff) by requiring 

S(s)a = a,\/s G (—oo, 0), Va G if. 

Since S'(s), s G [0,+oo), is a strongly continuous semigroup of continuous linear 
operators, there exists C G (0, +oo) such that 

(9.34) \\S( S )\U (H>H) ^C,V S €[0,n}; 
see Theorem A. 



on page 



375 From (9.34) and Definition A.6 



on page 



374 



sees that the map (si,S2) G K X [0,n] i— > S(s±)Bx(s2) G -ff is continuous. Hence, 
also using (9.191 and (9.22) (for Uj. and for m), one gets 



(9.35) 



/ (Uk(t 

Jo 



u(s))(S(t k - s)Bx(s) - f(s))ds 



as k — > +oo, 



H 



with f(s) := S(t - s)Bx{s), s G [0,n]. Let £ > 0. Since / g C°([0,n];H), there 
exist I G N, = si < «2 < . . . < s; = n, and I elements a%, a%, . . . , ai in H such that 

(9-36) \\f ~ g\\L°°((0,n);H) < £ > 

where 5 G L°°((0,n); _ff) is defined by 

(9.37) <7( S ) = a l ,Vse (s«, s i+1 ), Vt G {1,2, . . . J - 1}. 



Using ( |9.25| , ( |9.33| and (|9_37j, one gets 



(9.38) 



(ufc(s) - u(s))g(s)ds 







as fc — > +00. 



/-/ 



From ( |9.19| , (|9_22j), ( |9.35| , ( |9.36[ ) and ( |9.38| , one gets 

limsuppfe s: 2n {n+2 V {n+l \, 

k — >+oo 



which, since e > is arbitrary, gives (9.31). 

From (9.291, (9.30), (9.34 I and the Gronwall inequality, one gets 

\\yk(t)\\ H ^ Pfcexp (c\\B\\ c{ h,h) J \u k {s)\ds\ , 
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(9.21 1 and also of Theorem 9.4 



which, together with (9.221 and (9.31), proves (9.28). This concludes the proof of 



Coming back to Theorem |9.1| on page |248[ there are at least three points that 
one might want to improve in this result: 



Remove the assumptions (9.8) and (9.9) on the initial and final data 



- Weaken the regularity assumptions on the initial and final data. 

- Get information about the time T of controllability. 

Concerning the first two points, one can propose, for example, the following open 
problems. 

Open Problem 9.5. Let {ip° 7 S° 7 D°), ^ 1 ,S 1 ,D 1 ) G [SnHL(I;C)} xKxl. 



Do there exist T > and (ip,S,D,u) such that (9.10) to (9.15) hold? 
Open Problem 9.6. Let 



fff 0) (J;C) := W G H%L;C); <pW(-l) = <pW(l) = for k = 0, 1}. 
Let (^ ,S' ,-D ),(V' 1 ,5 rl ,D 1 ) G (§D #L(I;C)) xlxl. Do there exist T > and 



{tp 7 S 7 D 7 u) with u G L 2 (0 7 T) such that Ij9.10\ ), \9.lty , $9J3\ ), {9.1$ and {9.15\ ) 
hold? 

Remark 9.7. The conjectured regularity in Open Problem |9.6| comes from 
the regularities required for the controllability of linearized control systems (see 
Theorem |2.87| on page |96| Proposition |9.11| on page |256| and Proposition |9.15| on 
page 



2621 



Concerning the time of controllability, one may wonder if, for every e > 0, there 
exists n > such that, for every (ijj 7 S° 7 D°) 7 (ip 1 , S 1 , D 1 ) G (§ni? ( 7 0) (/;C))xlxl 
satisfying 

(9.39) 

(9.40) 



ll^ -^l(0,-)ll^(/;C) + |S | + |£°l<?7, 

||V 1 -V'i(£,-)ll^ (J;C) + |5 1 | + |Z) 1 |<'7 ) 



there exists {ip 7 S 7 D 7 u) such that ( |9.10| , ( |9.1l| , ( |9.12| , ( |9.13[ ), ( |9.14[ ) and (|9_15j) 
hold with T -— e and ||u||ffi(o, e ) 5S s. (Let us recall that ip\ is defined by (9.5 I, 



(9.4) and (9.7).) This question has a negative answer. More precisely, one has the 



following theorem (see [1171 Theorem 1.2] for a prior weaker result). 
Theorem 9.8. LetT > be such that 



(9.41) 



T< 



Then there exists e > such that for every D ^ 0, there is no u G L 2 ((0 7 T); (— e, e)) 
such that the solution (ip, S 7 D) G C°([0,T]; H%(I;C)) X C°([0,T]; M) X ^([O, T];K) 
of the Cauchy problem 

(9.42) fr = tyxx + i«(t)4 (*, x) G (0, T) x I, 

(9.43) x(>(t,-i) = il>(t,i)=0 i tG(0,T), 

(9.44) S(t) = u(t), D{t) = S(t), t G (0,T), 

(9.45) ip{0,x) = i/>i(0,x), xel 7 

(9.46) 5(0) = 0, D(0) = 0, 
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satisfies 

(9.47) i>(T,x) = ^ 1 (T,x),x£l, 

(9.48) S(T) = 0, D(T) = D, 

The remainder of this chapter is organized in the following way: 

- In Section [9.2| we sketch the main ingredients of the proof of Theorem |9.1| 

- In Section |9.3| we first give, in Section |9.3.1| some comments and explain 
the "raison d'etre" of Theorem |9.8| Then, in Section |9.3.2| we give the 
proof of Theorem 9.. 



9.2. Sketch of the proof of the controllability in large time 

In this section we sketch the proof of Theorem |9.1| Using the reversibility 
with respect to time of the control system (9.1 1-(9.2 |-(9.3|, it is sufficient to prove 
for n 1 



Theorem 



9.1 



Ho + 1. We prove it with n = 1 and n 1 = 2 to simplify the 
notations (the proof of the general case is similar) . 

The key ste p is then the s tudy of the large time local controllability of the 
control system ( |9.l[ )-( 9.2 l-(9.3 1 around the trajectory (Y 6 ,u = 0) for every 6 G 
[0,1], where 



(9.49) 



Y e (t) := (f e (t), 0,0) ei 2 (/;C) xKxt,Vfl£ [0,1], Vie 



together with 

(9.50) f e (t) := Vl - Ofait) + y/0ih,{t), V6> G [0, 1], Vt G R. 

Here and in the following, we write tpi(t) for ip\(t, ■), ip2(t) for ip2(t, ■), etc. In order 
to state such a controllability result, for 9 G [0, 1] and v > 0, let 

D{9,v) := {(<p,S,D) e (H 7 {0) (I ;C)nS)xRxR; \\<p- f e (0)\\ H ^i;C) + \S\ + \D\ < i/}. 

Let us also point out that 

fe(t + T ) = f e (t),VteR, V6»e[0,l], 

with 

8 
T := -. 



The large time controllability of the control system (9.1 1-(9.2 l-(9.3l around the 
trajectory (Y e , u = 0) we use is the following. 

Theorem 9.9. For every 6 e [0, 1], there exist n g e N \ {0} and vg > such 
that, for every (^°,S°,D a ) G D{0,v e ) and for every (^\ S 1 , D 1 ) G D{0,v e ), there 
exists {%l),S,D,u) such that 



(9.51) 
(9.52) 
(9.53) 
(9.54) 
(9.55) 
(9.56) 



VeC ([0,n e T ];7J ( 3 0) (/;C))nC 1 ([0,n e r ];^ 1 (J;C)), 

u G H^(O,n T O ), 

S e C\[0,n e T Q }), D e C 2 ([0,neM), 



(9.11, (9.2) and (9.3| hold. 



(i,(0),S(0),D(0)) = (i; o ,S o ,D ), 
(ij(neT ),S(ngT ),D(ngT )) = {^\S 1 ,D 1 ). 
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2o:i 



Let us assume, for the moment, that this theorem holds and we conclude the 
proof of Theorem |9.1| Let us first notice that 



(9.57) 
(9.58) 



fe(0)eH 7 m (I;C)r\S,We[0,l} 7 
the map 9 G [0, 1] v-* Y e (0) G H 7 {I; C) x R > 



is continuous. 



For 9 G [0, 1], let Ng be the minimum of the set of the ng G N \ {0} such that 
there exists vg > such that the conclusion of Theorem 9.9 holds. From (9.57) and 
(9.581, it is not hard to see that the map 

9 e [o, l] f-> Ng e N \ {0} 

is upper semicontinuous. In particular, since [0, 1] is compact, this map is bounded. 
Let us choose N G N \ {0} such that 

Ng^N,V6e [0,1]. 

Straightforward continuity arguments show that, for every 9 G [0,1], there exists 
vg > such that, for every «,S , °,D°) G D{9,v q) a nd for every (i/) 1 , S 1 , D 1 ) G 
D{6,vg), there exists {ip,S,D,u) satisfying (9.51) to (9.561 with ng := N. Let 
eg G (0, +oo] be the supremum of the set of such vg. Again it is not hard to check 
that the map 

6 G [0,1] ^ eg e (0,+oo] 

is lower semicontinuous. Hence, since [0, 1] is compact, there exists e > such that 

e <e e , V8& [0,1]. 

By construction, for every 9 G [0, 1], for every (ip°, S°, D°) G D(9, e), and for every 
(-ip 1 , S 1 , D 1 ) G D(9,e), there exists (ip,S,D,u) satisfying 

VGC ([0,7VT O ];7J ( 3 o) (/;C))nC 1 ([0,iVTo];ff o 1 (/;C)), 

S G C\[0,Nt o ]), D g C 2 ([0,Nt }), 

( [9~T] ), ( |9~2| ) and Q hold, 

(V(0),5(0), J D(0)) = (^ ,5°,C ), 

MNto),S(Nt ),D(Nt )) = (^ 1 ,5 1 ) D 1 ). 

Let fc G N \ {0} be large enough so that 

(9.59) D(j/k, e) n D((j + l)/k, e) ± 0, Vj G {0, . . . , fc - 1}. 
Let (t/. ,^ ,!) ) GD(0,e), (-0 1 , 5 1 , D 1 ) G£>(l,e) and 

(9.60) T:= {k + l)Nr . 



Let us check that there exists (if), S, D, u) such that (9.10) to (9.15) hold. By (9.59 1, 
there exists (ip J ,S J ,D J ) such that 



(^, S\ D>) G D(j/k, e) n D((j + l)/k, e), Vj G {0, . . . , k - 1} 
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which implies, for every j G {0, . . . , k — 2}, the existence of (tpj, Sj, Dj, iij) satisfying 

fa e c ([o > JV7 i ,];irf 0) (i;C))na 1 ([o,JV'n,];Ho 1 (J;C)) J 

Uj€HZ(0,Nt ), 
Sj € C\[0,Nt }), Dj € C 2 ([0,7Vr ]), 



( J9.ll , ( |9.2| and (|9_3|) hold for (ip,S,D,u,T) := {^ ,Sj, Dj,Uj, Nr ), 



Since 



(-0°, S a ,D°) e D(0, e) and (i>°, S°, D°) G D(0, e), 
there exists (V'-i* S'-ij -D-i, W-i) satisfying 

7A_ 1 eC ([0,iVr ];i7 ( 3 0) (7;C))nC 1 ([0,iVTo];7J 1 (/;C)), 

u_iGfr^(o,JV7to), 

5_x e ^([CiVro]), D-i € C 2 ([0,7Vr ]), 
( pTl} , |9~2| and Q hold for (ip,S,D,u,T) := ($_ 1 ,S_i,Z?_i,u_i,iV'To), 

(^_ 1 (o),^ 1 (o),^_ 1 (o)) = (v ,^ ,^ ), 

(^-i^Tft), 5-1(^71,), D_l(JV7b)) = (^°,5°,^ ). 

Similarly, since 

($ fc - 1 ,S*-\.D fc - 1 )eI>(M) and(V 1 ,S* 1 ,£' 1 ) €.0(1, e), 
there exists (V>fc-i, «S*_i, O fc _i, Ufe-i) satisfying 

V^fc-i e C°([0,iVT O ];if ( 3 o) (/;C))nC 1 ([0,7VTo]; J ff o 1 (/;C)), 
u k -ieH^(0,NT ), 

s k ^ e c 1 ([o,Nt ]), D k -i e c 2 ([o,Nt }), 

dlTl} , @ and {Taj hold for (tJj,S,D,u,T) := (&._!, 5 fc _i, O fc _l, u fc _i, JVr ), 

(ii(o),ii(o),Dn(o)) = (4> k -\s k -\D k - 1 ), 

(^_i(JVro),5 fe _i(^Vro),i> fe _i(JVro)) = (^.S 1 ,!) 1 ). 

Then, it suffices to define (ip, S, D,u) : [0, T] -> i7 ( 3 0) (7;C)xtxtxKby requiring 
besides (9.60), for every j € { — 1,0, . . . ,k — 1} and for every £ G [(j + 1)Nto, (j "1 

2)iVr ], 

^(£):=(^(t-(j+l)Afr ), 
S(t) :=Sj(t -(j + 1)Nto), 

D(t):=D 3 (t-(j + l)NT ), 
u{t) :=Uj(t-(i + l)7V ro )). 

This concludes the proof of Theorem |9.1| assuming Theorem |9.9| I 
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2o5 



It remains to prove Theorem 9.9 



on page 



252 The strategy for 9 G (0, 1) is 



different from the one for 9 G {0, 1}. In the next sections, we detail both strategies. 



We start (Section 9.2.1 I with the simplest case, namely 9 G (0, 1). Then, in Section 



9.2.2 we treat the more complicated case, namely 9 G {0, 1}. 



9.2.1. Local controllability of the control system (9.1 )-(9.2)-(9.3 ) 



around (Y , u = 0) for 9 G (0, 1). As we have seen earlier, for example in Section 
|3.1| and in Section [4. 1| a classical approach to prove the local controllability around 
a trajectory consists of proving the controllability of the linearized system along the 
studied trajectory and concluding with an inverse mapping theorem. This strategy 
does not work here because the linearized system around (Y e (t),u = 0) is not 
controllable. Let us check this noncontrollability. For ip G S, the tangent space 
T§(ip) to the L 2 (7; C)-sphere at the point ip is 

(9.61) T S V := & G L\I- C); 8%, V) = 0} , 

where 



and, for z G 



(cp,^) := / <p(x)1>(x)dx, V(^) G L 2 (I;CY 



tftz is the real part of z. 



Let us also recall that 9z denotes the imaginary part of z G C. 

The linearized control system around the trajectory (Y e ,u = 0) is 



(4)< 



*t = i^xx + iwxfe, (t, x) G (0, T) x /, 
*(* > -l) = *(t l l) = 0,t€(0,T), 

s = w, 
d = s. 



It is a control system where, at time t, 

- The state is (9(t,-),s(t),d(t)) G L 2 {I; C) xR x K with 9(t, ■) G T s (f 6 (t,-)), 

- The control is w(t) G K. 

Proposition 9.10. Let T > and ((^,s,d),w) be a trajectory of (T, l g ) on 
[0,T]. Then the function 

t ^ 9f((*(t),v/T^&i(i) - \/^a(*)», 

js constant on [0,T]. In particular, the control system (Sg) is noi controllable. 

(In this proposition and, more generally, in this section as well as in Section 
|9.2.2[ we do not specify the regularities of trajectories and solutions of Cauchy 
problems: these regularities are the classical ones.) 

Proof of Proposition |9.10[ Let us consider the function 

&(i, •) := y/T^O^t, ■) - V9Mt, ■)■ 



(9.62) 
We have 



tet = itexx, (t,x) g (0,T) x J, 



d/ 



(9(*(t),6(<)» = SMar/eW, 6 («)». 



2r.(. 
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The explicit expressions of fg (see (9.50 1 ) and £g (see (9.62 1 ) show that, for every 
t£[0,T], 

which gives the conclusion. 

Let T > 0, and *° G T s (/g(0)), tf 1 G T s (/g(T)). A necessary condition for the 
existence of a trajectory of (Eg) satisfying ^(O) = \I /0 and \&(T) = ^P 1 is 

9((* x , \ZT^i(T) - ^ 2 (T)» = 9((*°, vT^e^ - v^}). 

This equality does not hold for an arbitrary choice of ^>° and ty 1 . Thus (Eg) is not 
controllable. ■ 



Let us now show that the linearized control system (Eg) misses exactly two 
(oriented) directions on the tangent space to the sphere §, which are (^,5, D) := 
(±i£g,0,0). (So the situation is the same as for the nonlinear Korteweg-de Vries 
control system (8.5 )-(8.6) with the critical length L = 2irk with k G N\{0} satisfying 



8); see Section 8.2 



PROPOSITION 9.11. LetT > 0, (#°,s >d°),(*\s\d 1 ) G Hf 0) (I,R) xlxlle 
such that 

(9.63) ^^°,fe(0))=^(^\fe(T)) = 0, 

(9.64) S(* 1 , VT^0<p 1 e- iXlT - Ve^ 2 e~ iX2T ) = 3<¥°, s/T^Oifi - V9ip 2 )- 
There exists w G L 2 (0,T) such that the solution 

(*, s, d) : [0, T] -* L 2 (I; Qxlxl 
of (Eg) wii/i control w and such that 

(*(o), s (om(o)) = (*°, s V°) 

satisfies 

(*(T), S (T),d(T)) = (* 1 ,a 1 ,d 1 ). 



Before giving the proof of this proposition, let us point out that, by (9.61 1, the 



condition (9.631 just means that 

*° € T s (/g(0)) and I- 1 G T s (/g(T)). 

Proof of Proposition |9.11[ The proof is similar to the proof of Theorem |2.87| 
on page 



96 



It also relies on moment theory. Let (^°, s°, d°) G L 2 (I,K) xKx 
with * u G T s (/g(0)) and T > 0. Let (®,s,d) be a solution of (Eg) with 
(*(0),a(0),d(0)) = (*°,s°,d°) and a control w G L 2 (0,T). We have the following 
equality in L 2 {I; C): 

oo 

tf(t) =£ a* (t)p* whereat) := (*(i), ^ fc >, Vfc € N\ {0}. 

fc=i 
Using the equation satisfied by vp, we get 

(9.65) i 2 fc(t) = (<*°, ^2fc) + *vT^0& 2fc /" W (r)e l ( A2fc - Al ) T dr") e"^', 

(9.66) cc 2 fc-i(t) = (V, p 2 *-i) + iWpafc,! J w^e'^-^^dA e"^*- 1 *, 
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where, for every k £ N\{0}, 6fc := (xifk, <fi) and Ck '■= (xifki <P2)- Using the explicit 
expression of the functions (p^ (see (9.6 l-(9.7l), we get 



(9.67) 



(9.68) 



Cfc 



if k is odd, 

-16(-l) fe / 2 fc 

7T 2 (l + fc) 2 (l-fc) 2 

32 (-l)(fc-i)/2fc 

7T 2 (fc + 2) 2 (fc-2) 2 

if fc is even. 



if fc is even, 
if k is odd, 



Let (^ 1 ,s 1 ,d 1 ) € L 2 (I, 



with tf 1 e T s {fg{T)). The equality 



(4 , (T),s(T),d(r)) = (\P , s , d ) is equivalent to the following moment problem 
on w. 



(9.69) / w^e^x-^dt 



vT 



>2k 



((V 1 ,<P2k)e i> »* T - (*°, ¥>2k» , Vfc e N \ {0}, 



(9.70) 



w(t)e 



i(>>2k 



- X ^dt 



Ve 



C2fc-1 



«*\ ^_i)e iA2fc - lT - (tf°, V2k-i)) , Vfc e N \ {0}, 



(9.71) 



(9.72) 



w{t)dt = s 1 



(T - t)w(t)dt = d 1 - d° - s°T. 



In (|9.69|)-(|9.70|) with k = 1, the left hand sides are complex conjugate numbers 

62 = Ci. Hence 



because w is real valued. Note also that, by (9.67) and (9 



a necessary condition on ^° and 'J 1 for the existence of id £ L 2 (0,T) solution of 



(9.69l-(9.70l is 



(9.73) ^=L= ((*i, Va )e-^ T - (*°, ^)) 



V£ 



((^^^-(vP ,^}). 



The equality of the real parts of the two sides in (9.73 ) is guaranteed by (9.63 I . The 



equality of the imaginary parts of the two sides in (9.73) is equivalent to (9.64 I 



Under the assumption * ,* 1 e Hf Q) (I;C), the right hand sides of (|9.69|)-(|9.70|) 



define a sequence in Z 2 (C). Then the existence, for every T > 0, of w € L 2 (0,T) 
solution of (9.69) to (9.72) is a classical result on trigonometric moment problems 



see, for example, 42 2, Se ction 2], or [282, Section 1.2.2]. In fact, if one doe s not 
care about condition (9.72 1, the existence of w G L 2 (0, T) follows from Theorem 
on page [98] 



2.i 



Coming back to our controllability statement, let us try to follow the approach 



(power series expansion) we used for the nonlinear control system ( 8.5 1-( 8.6 ) (see 



2r.S 
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page 237) with the critical lengths L = 2irk with k G N \ {0} satisfying (8.8 1 (see 
Section 8.2 and ^122]). We first try to move in the (oriented) directions which are 
missed by the linearized control system (£#)• This can be done and this is simpler 



than for the nonlinear KdV control system (8.5 l-(8.6l, since the order 2 is sufficient 



to do this motion. Indeed, one has the following proposition. 



PROPOSITION 9.12 (g3j Theorem 6]). Let T := 
Hq(0,T), u± G Hq(0,T) such that the solutions of 



/ir. There exist w± G H A n 



(9.74) 



(9.75) 



*±t = »*±x» + iw±xf e , (t, x) e (0, T) x /, 

*±(0,x) = 0,i6/, 

*±(i,-l) = *±(t,l) = > tG(0 > T), 

s± = w±,s±(0) =0, 

4 = «±,d±(0)=0, 



t±t=ii±xx + iw ± x^ ± +iv ± xf e , 
£±{0,x) = 0,xel, 

e±(*,-i) = e±(*,i) = o,tG(o,r), 

cr± = v±:<r±(0) = 0, 
5± = o-±,5±(0) = 0, 



satisfy *±(T, •) = 0, s±(T) = 0, d ± {T) = 0, £±(T) = ±iip t , a ± = 0, S ± = 0. 

The time T = 8/77 is not optimal, but our guess is that T cannot be arbitrarily 
on page 



small (see also Theorem 9.8 



251 and Open Problem 9.18 



on page 



2681 



Unfortunately, the fixed-point argument we used for the nonlinear KdV control 
system (8.5l-(8.6l with the critical lengths L = 2-Kk, with k G N\ {0} satisfying 



8) (see Section 8.2) no longer works. The reason is the following one. Let us 
introduce the following closed subspace of L 2 (I; C), 



II := Span{(/?fe; k ^ 2} 

and the orthogonal projection V : L 2 (/;C) — > II. Let <1> be the map defined by 

$ : (V ,S ,£%) -» tt>°,S°,D°,ViP(T),S(T),D(T)), 

where ip solves 

ip = it/}" + iuxip, 
w, 

--s, 

with (tp(0),S{0),D(0)) = (tP°,S°,D°). Let ff 2 0) (/;C) be defined by 

Hf Q) (L;C) := {^ G tf 2 (I; C); <p G fl^I; C)}. 
The map $ is of class C 1 between the spaces 



S-- 

D 



<l> : 


[SniJ ( 2 0) (/;C)] xRxIxL 2 (0,r) 




^[§n ff ( 2 0) (/; C)]xixtx[nn H f )(^ 


$ : 


[S n # ( 3 0) (I; C)]xlxlx i?,J(0, T) 




^[sn iT ( 3 0) (J; C)]xixix[nn # ( 3 )U; 
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So we would like to have a right inverse to the map rf$(/e(0), 0, 0, 0) which is a map 
between the spaces 

[7s(/e(0))n J ff ( 2 0) (/;C)] xRxRx [II n Hf Q) (I; C)] xlxl 

- Ps(/ fl (0)) n ff ( 2 0) (/;Q] x R x R x L 2 (0,T), 
or 

PM/e(0)) n Hf 0) {I; C)]xlxlx[nn Hf 0) {I; C)]xRxI 

-> [T s (/ 9 (0)) niJf 0) (/;C)] x R x R x fl^O.T). 

The controllability up to codimension one given in Proposition 9.11| for the lin- 
earized system around (Y e , u = 0) only provides a right inverse for d$(/g(0), 0, 0, 0) 
which is a map between the spaces 

PMM0)) n ff ( 3 0) (I; C)]xlxlx[nn Hf 0) (I; C)]xRxI 

-> [T§(fe(0)) n Hf 0) (I;C)} x R x R x L 2 (0,T). 

In order to deal with this loss of regularity in the controllability of the linearized sys- 
tem around (Y s ,u = 0), we use a Nash-Moser fixed-point method directly adapted 



from the one given by Lars Hormander in [238]. See also Section 4.2.2 and the 
paper [40 by Karine Beauchard, where the Nash-Moser method has been used 
for the first time to solve a controllability problem. This requires some lengthy 
computations which are detailed in [43 . 



9.2.2. Local controllability of the control system (|9.l[)-(|9.2[)-(|9.3[) 
around (Y k ,u = 0) for k g {0, 1}. Again, the classical approach does not work 
because the linearized system around (Y , u = 0) is not controllable for k € {0, 1}. 
This result was proved by Pierre Rouchon in |417j . (He also proved that this 
linearized system is steady-state controllable, but this result does not imply the 
same property for the nonlinear system.) The situation is even worse than the 
previous one because the linearized system misses an infinite number of (oriented) 
directions (half of the projections). Indeed, the linearized system around (Y , u = 
0) is 

9 t = m ;€X + iwxtp 1 , (t,x) e (0,T) x /, 

*(t ) -i)=*(t,i) = o ) te(o,T), 

s = w. 



(4)4 
d 



It is a control system where, at time t G [0,T], 

- the state is (*(t, •), s(t), d(t)) e L 2 (I;C) x R x R with #(£) g T s (^i(i)) for 
every t, 

- the control is w(t) g R. 

Let (*°,s°,(i ) g Ts(V>i(0)) x R x R and (®,s,d) be the solution of (E' ) such 
that (*(0),a(0),d(0)) = (*°,s°,d°), with some control w g L 2 (0,T). We have the 
following equality in L 2 (I; C): 



^ 



*(t) = V x k (t)if k , where x k (t) := (*(t), p fc ), Vfc g N \ {0}. 



fc=i 



Using the evenness of the functions (/ :, 2fe+i and the equation satisfied by \p, we get 

±2fe+i = -*A 2 fe+ia;2fe + i,Vfc g N. 
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Half of the components have a dynamic independent of the control w. Thus the 
control system (Sq) is not controllable and the dimension of the uncontrollable part 
is infinite. 



The proof of the local controllability of the control system (9.1 l-(9.2l-(9.3) 
around Y k for k € {0, 1} relies on: 

1 . the return method (see Chapter p\ , 

2. quasi-static deformations (see Chapter ut, 

3. power series expansion (see Chapter^]). 

Let us explain the main steps in the case of Y°; everything works similarly with 
Y 1 instead of Y°. First, for 7 / and (a , 0) G R 2 we construct a trajectory 



(y 7,a 'P, u = 7) such that the control system (9.1 l-(9.2l-(9.3) is locally controllable 
around (Y 7,ct ' ,9 ,7) on [0, T*] for some T* . Then one deduces the local controllability 
(for suitable norms) around Y° by using quasi-static deformations, in the same way 
as in Section 6.3 (see also |40| Theorem 11, page 916]). Let Yq be given close to 



Y (0) and Y\ be given close to Y (0). We use quasi-static deformations in order to 
steer the control system: 

- from Yq to a point Yq which is close to y 7,a ' /3 (0), for some real constants 
a, /3, 7, 

- from a point Yj., which is close to Y~ l,a 'P(T*), to Y\. 

By "quasi-static deformations" , we mean that we use controls t 1— > u(t) which 
change slowly as in Section 6.3 (see in particular Proposition 6.31 on page 
on page 



Proposition 6.32 



217] and 
217) and as in Chapter u\ Using the local controllability 



around Y 7 ' 0,13 , we can then steer the control system from Yq to Y\ in time T* 
and this gives the conclusion: We can steer the control system from Yq to Y\, by 
steering it successively to Yq, to Y\ and, finally, to Y\. 

Let us give the construction of Y 1 ' 01,13 . Let 7 G R \ {0}. The ground state for 
u = 7 is the function 

4>x a {t,x) := ip ln (x)e- tXl --' t , 

where Ai i7 is the first eigenvalue and (£>i, 7 the associated normalized eigenvector of 
the operator A 7 defined on 



-if — jxtp. 

r (t,•),a + 7t,yS^ 
solves (l9~Tl)-(l9~2l-(l9~3l) with u = 7. We define T := 





A~/ip 


a, /3 G K, the function 




Y*t> a >P{t) := 


(^1,7 



at + -/t 2 /2) 
\/ir, T* := 2T and the space 



H 7 h) (I;C) :={tp£H 7 {I;C);A r >ip exists and is in ffj (J; C) for n = 0, 1,2,3}. 

Then one has the following theorem. 

Theorem 9.13 ( |43| Theorem 8]). There exists 70 > such that, for every 7 € 
(0,7o), there exists 5 = 6(7) > 0, such that, for every (tp° , S° , D°), (ip 1 , S 1 , D 1 ) G 
[S n H 7 h) (I; C)]xlxl and for every (a, 0) G R 2 ) with 

H° ~ iM0)Hh*(ZsC) + \S° ~a\ + \D° -P\<6, 

U 1 - Vi, 7 (T*)||^ (/;C) + \S 1 -a- 1 T*\ + \D 1 -(3- aT* - jT* 2 /2\ < S, 
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2(il 



for some real constants a, (3, there exists v € -ffg((0, T*),M.) such that the unique 
solution 

(*, S, D) e (C°([0, T*]; H 3 {I; C))nC 1 ([0, T*];H%(I; C))) x C x ([0, T*]) x C°([0, T*]) 



of (9.1)-(9.2)-(9.3) on [0,T*], iw'i/t control u := 7 + u, smc/i i/iai 

WO),S(0),£(0)) = (^ ,S ,D ), 

saiis/ies 

(^(T*),5(T*),^(T*)) = (V 1 ,5 1 ,^ 1 ). 

Let us explain the main ingredients (and main difficulties) of the proof of this 
theorem. The linearized control system around (Y' y,a '^,u = 7) is 

\& t = i\$> xx + ij X \ii + iwxipi tJ , (t, x) e (0, T) x /, 

, I *(t,-i) = *(i,i) = o,te(o,r), 

^ 1 ' J s = w, 
d = s. 

It is a control system where, at time £, 

- The state is (*(£, ■), s{t), d(t)) € L 2 (I; C) with *(i, •) e T s (V>i, 7 (t, •)). 

- The control is w(t) e K. 

Let us study the controllability of the linear control system (E|L). Let us 
recall (see page 95) that the space L 2 (J;C) has a complete orthonormal system 
(v*;,7)feGN\{o} of eigenfunctions for the operator Ay. One has 

where (Afc. 7 )fc G rj\ / } is an increasing sequence of positive real numbers. Let 

frfc, 7 := (fk, 7 ,x(pi^). 

By Proposition 2.90 on page 98 (see also [401 Proposition 1, Section 3.1] or [401 
Proposition 41, page 937-938]), for 7 small enough and different from zero, bk tl is 
different from zero for every k € N \ {0} and, roughly speaking, behaves like 1/fc 3 
when k — > +00. Let us first give a negative result showing that the linear control 
system (T, ) is not controllable (in contrast to the case where one does not care 



about s and d: see Theorem 2.87 



on page 



961. 



Proposition 9.14. Let T > and (^,s,d) be a trajectory of (£' ) on [0,T]. 
Then, for every t £ [0, T], we have 

(9.76) s(t) = s(0) + -*- «¥(*), ^i,7>e Ul -' - (*(0), <^, 7 » . 

i6i !7 

Thus, the control system (Si) is noi controllable. 



Proof of Proposition 



9.14 



Let xi(i) := (9(t), y>i, 7 ). We have 



*i( f ) = (-qt(*)> ^1,7) = (-^ 7 *( t ) + iw(t)xipi^(t, •), y>i i7 ), 



which leads to 



We get (9.76) by using 



x x (t)= (ari(0) + i&i )7 / tu(r)dr) e _iAl ^'. 

s(i) = s (0) + / «j(r)dr. 
Jo 
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Let T > 0, #° G I$(V>i, 7 (0)), tf 1 G Ts(V>i, 7 (T)), s^s 1 el. A necessary condition 
for the existence of a trajectory of (S_) such that $(0) = *°, s(0) = s°, *(T) = Vf 1 , 
s(T) = s 1 is 

(9.77) 



s 1 -* 



*0l,7 



((* 1 > ^ ll7 )e* A '^ T - <*°,^i f7 )) • 



This equality does not hold for an arbitrary choice of 9°, ty 1 , s°, s 1 . Thus (Si) is 



not controllable. This concludes the proof of Proposition 9.14 



Our next proposition shows that (9.77 1 is in fact the only obstruction to con 



trollability for the linear control system (£' ). 

PROPOSITION 9.15. LetT > 0, (*°, s°,d°), {9 1 ,s 1 ,d 1 ) G iI ( 3 0) (J;C) xIxRie 
suc/i i/iai 



(9.78) 
(9.79) 



R(* o ,^i, 7 (0)) = K^ 1 , Vi, 7 (T)) = 0, 



'1,7 



(«^, 7 )-<*\^ 7 )e^ T ) 



TTien there exists w G L 2 (0,T) such that the solution of (SL) wii/i control w and 
such that (*(0),s(0),d(0)) = (*°,s°,d°) sate^es (*(T), s(T), d(T)) = (* 1 ,s 1 ,d 1 ). 

Remark 9.16. We can control W and d but we cannot control s. We miss only 
two (oriented) directions which are (\&,s,d) = (0, ±1,0). 



Proof of Proposition 



9.15 



Let (*°,s°,d°) G T s (V>i )7 (0)) x R x 



and 



T > 0. Let (*,s,d) be a solution of (£ 7 ) with (*(0),s(0),d(0)) = (*°,s°,d°) 
and a control w G L 2 (0,T). Let (* 1 ,s 1 ,d 1 ) G T s (^i i7 (T)) x R x K. The equality 
(\& (T) , s(T) , d(T)) = ($ 1 ,s 1 ,d 1 ) is equivalent to the following moment problem on 



(9.80) 



(9.81) 



(9.82) 



;(t) e *(^.-r->i.-r)*di 



fc,7 
T 



((*°, <^, 7 ) - {W 1 , p* tT )e iA *" r ) , Vfc G N \ {0}, 



w{t)dt = s 1 -8°, 



n 



(T - t)w(t)dt = d 1 -d° - s°T. 



The left hand sides of (9.80) and (9.811 with k = 1 are equal, the equality of 



the corresponding right hand sides is guaranteed by (9.791. Under the assumption 
9°, V 1 G Hf Q) (I; C), the right hand side of (|9.8l|) defines a sequence in Z 2 (C). Thus, 



under the assumptions (9.791 and ^P ,^ 1 G H? Q JI; C), the existence of a solution 
u> 6 L 2 (0, T) of the moment problem (9.80)-(9.81 )-(9.81 ) can be proved using the 



same theorem on moment problems as in the proof of Proposition |9 . 1 1" on page [256] 
(see also [401 Theorem 5]). This concludes the proof of Proposition 9.15 
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Two difficulties remain: 
1. First one has to take care of the fact that the linearized control system 
misses two (oriented) directions. In order to take care of this problem, one 
uses again power series expansion as in Section |9.2.1| 



2. As in Section 4.2.2 for the Schrodinger control system (4.85 l-(4.86l (i.e 



our control system (9.1 l-(9.2l-(9.3) but without taking care about 5 and 



D) there is a problem of loss of derivatives. One handles this problem with 



a Nash-Moser iterative scheme briefly sketched in Section 4.2.2 and due to 
Karine Beauchard 



We refer to [43] for the full details. This concludes the sketch of the proof of 
Theorem [9J] on page |248| ■ 

9.3. Proof of the nonlocal controllability in small time 



In this section we give the proof of Theorem |9.8| on page |25J] First, we make 
some comments about this theorem. 



9.3.1. Comments on and "raison d'etre" of Theorem [978] on page [251] 

Since we are looking for a local statement, it seems natural to first look at the case 



where one replaces the control system (9.1 1-(9.2 l-(9.3l with its linear approximation 



along the trajectory ((-0i, 0, 0), 0). This linear approximation is the control system 

(9.83) Vt = iipxx + Mi, (t, x) G (0, T) x /, 

(9.84) v(*,-i) = V'(t,i)=o,*€(o,r) > 

(9.85) S(t) = u(t), D(t) = S(t), t G (0,T). 

For this control system, the control at time t is u(t) G K and the state is ip(t, •) G 
L 2 (!;€.), with now 



(9.86) 



(ip(t, x)^i(t, x) + 4>{t, x)ipi(t, x))dx 



However, it has been proved by Pierre Rouchon in [417j that Theorem 9.8 does 
not hold for the linear control system ( 9.83 1-( 9.84 1-( 9.85 I . More precisely, Pierre 



Rouchon proves in [417J the following theorem. 

Theorem 9.17. Let T > 0. Then there exists C > such that, for every 
D£l, there exists u G L°°(0,T) such that the solution 

0>,S,D) G C°([0,T];Ht(I;C)) x C°([0,T};R) x ^([O.TjjM) 

of the Cauchy problem 



(9.87) 

(9.88) 

(9.89) 

(9.90) 

(9.91) 

satisfies 

(9.92) 

(9.93) 



A = iipxx + iuxtpi, {t, x) G (0, T) x /, 
V(i,-i) = ^(i,i) = o, *e(o,T), 

S(t) = u(t),D(t) = S(t),te(0,T), 

tp(0,x) = tpi(0,x), x G /, 

5(0) =0, D(0) =0, 

ip(T,x) = ipi(T,x), x e I, 
S(T) = 0, D(T) = D. 
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Furthermore, u satisfies 

IMIi-(o,T) < C\D\. 

Let us point out that it is also proved in |417j that the linear control system 
( |9.83|)-(|9 84| )-( |9.85| is not controllable on [0,T], whatever T > is. But, by The- 



orem 



9.1 on page 248 the nonlinear control system (9.1 l-(9.2l-(9.3) is large-time 



locally controllable along the trajectory ((ipi, 0, 0), 0). More precisely, by (the proof 



of) Theorem 9.1 for every e > 0, there exist r\ > and T > such that, for every 



{ 1 p°,S ,D°),W,S\D l )€(SnHj m (I;C))xRx 

\S°\ 
IS 1 ! 



X with 

\D°\<V, 
\D X \<V, 



H° - M0)\\hUI;C) ■ 

\\lfj 1 - ll>l(T)\\ H 7( I . C ) 

there exists (ip,S,D,u) such that 

^eC°([0,T];7J ( 3 0) (/;C))nC 1 ([0,T];ir o 1 (/;C)), 

SeC'do.r]), D€C 2 ([o,T\), 



(9.1), (9.2) and (9.3| hold 



(V>(0),S(0),£(0)) = (^°,S o ,D ), 

(i>(T),S(T),D(T)) = (i J 1 ,S 1 ,D 1 ), 

\\m ~ Mt)\\H*(i;C) + \S(t)\ + \D(t)\ + \u(t)\ < e, Vt G [0,T]. 

So, in some sense, the nonlinearity helps to recover local controllability but prevents 
us from doing some specific natural motions if the time T is too small; motions which 



are possible for the linear control system (9.83 I- (9. 84 I- (9. 85 I even if T > is small 



Let us now explain why Theorem 9.8 is in fact rather natural if one looks at the 



obstruction to small-time local controllability given by Theorem |3.36| on page |145| 
for finite- dime nsional contr ol systems. In order to deal with an equilibrium (as in 

s lXlt %l>(t,x). Then the control system for 



Theorem 



3.36 



on page 



145), let ${t,x) 



is the following one: 



= i8 xx + i\i9 + ixu9, (t, x) e (0, T) x I, 

0(i l -i) = 0(i > i)=O,te(O,T), 
S(t) = «(<), t>{t) = S{t), t e (0,T). 



At a formal level, it is an affine system similar to the control system (3.84), with 

f ((6, s, D) tT ) = (ie xx + ix t e, o, s) tr , Me, s, £) tr ) = {ixo, i, o) tr . 

Note that 

/o((^,0,0) tr ) = (0,0,0) tr . 



Hence (3.831 holds (at (<pi,0,0) instead of 0). Formally again (see in particular 
( |3.19| ), we get 

[/ lj /o]((0,5 J D) tr ) = (-2^ ! O,l) tr , 



(9.94) 

(9.95) 

In particular, 

(9.96) 



ad^ i /o((vi,0,0) tr ) = (-2^ 1 ,0,0) tr . 
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(For the definition of ad? /o, p G N, see Definition 3.11 on page 130 ) If one wants to 
check the assumption of Theorem 



3.36 



on page 



145 



one needs to compute ad* /i. 
cets are not well defined; even at a formal 



Unfortunately, these iterated Lie brae 
level, Dirac masses appear on the boundary of I if k ^ 2 (see also (5.5 )). However, 
at least in finite dimension, Span{ad* fi(xo)\ k G N} is the linear space of states 
which can be reached from the state for the linearized control system around 
the equilibrium xo. Let us point out that the linearized control system around the 
equilibrium ((</?i, 0, 0) tr , 0) is the control system 

(9.97) Q t =ie xx + i\ t e + ixuipi, (t,x) G (0,T) x I, 

(9.98) e(t,-l) = 6(t,l) =0, t€ (0,T), 

(9.99) S(t) = u(t), D{t) = S(t), t G (0,T), 

where, at time t G [0,T], the state is (6(t, •), S, D) G H$(I;C) x R x E with 
Jj(Q(t, x) + 0(£, x))ipi(x)dx = and the control is u(t) G R. For this linear control 
system, by symmetry, for every u G L 2 (0,T), the solution G C ([0, T]; Hq(I;C)) 
of | [9.97| )-| |9 98| -( |9.99| such that 9(0, ■) = satisfies 

Q(t,-x) = -@(t,x), (t,x) e (0,T) x I. 



(In fact, using moments method as in the proof of Proposition 9.11 



on page 



256 



and as in the proof of Proposition |9. 15] on page [262] it is not hard to check that, at 
least if one does not take care about regularity problems, the set of (9, S, D) tr such 



that the linear control system ( 9.97 )-( 9.98 )-( 9.99) can be steered from (0,0,0) tr to 
(0, 5, D) tr is the set of all the (6, 5, L») tr 's such that 6 is odd.) Hence, still at a 
formal level, 

Span{ad5; o / 1 (((p 1 ,0,0) tr );fceN}c {(tp, S,D) tT ; <p is odd, Sei.flGl}, 



which, together with (9.951, implies that 

ad 2 fl fo((ipi,0, 0) tr ) $ Spau{ad) /i(fo>i, 0, 0) tr ); k e N}, 
which, by Theorem |3.36| on page [145] for k = 1, motivates the uncontrollability 



result stated in Theorem 19.81 

However, the previous motivation is purely formal. Let us try to follow the 



proof of Theorem 3.36 sketched above (see in particular page 145). One first needs 
to choose a suitable (j) : (H$(I; C) !~l S) x K x K - 



(9.100) 
(9.101) 
(9.102) 

(9.103) 



► M. This cf> must be such that 
(^,0,0) = 0, 
0'(<pi, 0,0) (0,0,0) =0, V0ei^(I;C) such that 6{-x) = -0{x), Vrc G I, 

0'(^i,O,O)(2 i ^ 1 ,O,O) = l, 

<j>'(9,S,D)(ix9,l,0)=0,V(9,S,D) G (H% ( I; C) n S) xlxl 

close enough to (</?i,0,0). 



There are many </>'s which satisfy ( |9.100[ ), ( |9.101[ ), ( |9.102[ ) and ( |9.103[ ). The simplest 
one seems to be 



(9.104) 



<t>(9,S,D):= 



1 



(0(0) - 0(0)). 



But if one takes such a </>, it seems that some problems appear in order to get 
(3.1081. These problems come from the fact that the norms H k (I;C), k G N are 
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not equivalent. We will choose another (f> (<f> is one half of the real part of V, where 



satisfy (9.103) 



V is defined by (9.116)). This satisfies (9.1001, (9.101) and (9.102), but does not 



9.8 



9.3.2. Proof of Theorem 

£ G (0,1]. Let u G L 2 ((0,T);R) beluch that 



Let T > be such that (9.411 holds. Let 



(9.105) 



|u(t)|<e,te(0,T)- 



Let (tp,S,D) G C°([0,T];i^(I;C)) x C°([0,T]) x C l ([0,T]) be the solution of the 
Cauchy problem 



(9.106) 
(9.107) 
(9.108) 
(9.109) 
(9.110) 



A = ii>xx + iu(t)xtp, (t, x) G (0, T) x /, 

V(i,-1) = ^(M) = 0, *e(0,T), 

S(t) = u(t),D(t) = S(t),te(0,T), 

tp(0,x) = ipi(0,x), x € I, 

5(0) =0, D(0) =0. 



(Let us recall that ipi is defined in (9.4) and (9.7).) We assume that 

(9.111) 5(T) = 0. 
Let 6 G C°([0, T]-Hl(I; C)) be defined by 

(9.112) 6»(t, x) := e iXlt il)(t, x), (t, x) G (0, T) x I. 



From (9.4), (9.7l, (9.1061, (9.107), (9.109) and (9.1121, we have 



(9.113) 
(9.114) 
(9.115) 

Let V G C°([0,T];C) be defined by 
(9.116) 



't = iQxx + i^-iQ + iux6, (t, x) G (0, T) x I, 

9(t,-l) = 6(t 7 l) = 0,te(0,T), 

6(0, x) = (fi(x), x € I. 



V(t) -=-i + i 6(t, x)cpi(x)dx, t G [0, T]. 



From ( |9.7[ ), (|9_115j) and ( |9.116| , we have 
(9.117) V(0) = 0. 



From (9.7), (9.113), (9.1141 and (9.1161, we get, using integrations by parts, 



V 



(9.118) 



+ \i6 + ux6)ipidx 



-u I 6x<fidx. 



Let Vi G C°([0,T];C) be defined by 



(9.119) 



Vi(t) 



6(t,x)xtpi(x)dx, t G [0,T]. 
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From (9.7), (9.113), (9.1141 and (9.1161, we get, using integrations by parts, 



Vi 



(9.120) 



-i I (t*xx + Ai$ + ux9)x<pidx 

-i I 0((x(pi) xx + XiXifijdx — iu I x 2 8ipidx 

-2i / 9ipi x dx — iu I 6x ipidx. 



From ( |9.108| , ( |9.110[ ), ( |9.11l| , ( |9.117| ), ( |9.118| , ( |9.119[ ), ( |9.120| and using integra- 
tions by parts, one gets 

(9.121) V(T)= [ S(t)V 20 {t)dt+ [ S(t) 2 V 21 {t)dt, 

Jo Jo 

where V 20 G C°([0,T];C) and V 2 i G L°°((0,T);C) are defined by 



V 20 (t) := 2i / e(t,x)cp lx (x)dx, t G [0,T], 



V 21 {t):=--J e t (t,x)x 2 ip x (x)dx,te [0,7]. 



(9.122) 

(9.123) 

Let us first estimate V 20 (t). Let / G C°([0,T]; H%(I; C)) be defined by 

(9.124) f(t,x) := ^(a;)e MS W, (t,x) G [0,T] x /. 

Let g G C°([0, T]; L 2 (J; C)) be the solution of the Cauchy problem 

(9.125) g t = ig xx + i\ x g - 2S(t)ip lx , (t, x) G (0, T) x /, 

(9.126) g(t,-l) = g(t,l)=0,te(0,T), 

(9.127) g(0,x) = 0, xel. 

Finally, let r G C°([0, T]; L 2 (7; C)) be defined by 

(9.128) r(t, a;) := 0(t, a;) - f(t, x) - g(t, x), {t, x) G [0, T] x /. 



From j9.7| , J9_108|, fl9.110[ ), ( |9.113[ ), ( |9.114| , fl9.115| , (|9_124j), (|9_125j fl9.126| , 
(|9.127| and (|9.128|, we get that 



(9.129) 

(9.130) 
(9.131) 



r t =i r xx + i\\T + iuxr — iS <fxe lx 

+ 2S(p lx (l - e lxS ) + iuxg, (t, x) G (0, T) x /, 

r(t, -1) = r(t, 1) = 0, iG(0,T), 
r(0,a;) = 0, a; G J. 



From (|9_7j), (|9_125j), ( |9.126| and ( |9.127| , we have 

(9.132) \\g(t, 0||i«(/;C) < 2||^ 1;E || L2(/) /" |5(r)|dr = tt / |5(r)|dr-. 

Jo Jo 



From (9.1051, (9.1081, (9.1101, (9.129), (9.130), (9.1311 and (9.132), we get 



(9.133) ||r(V)|| i2(/;C) < / S 2 (T) + 2S 2 (T)\\i flx \\ LHI) + \u(T)\\\g(r 1 -)\\ L , {I , c) dT 

^ Ce\\S\\ L 2 {0t T), t € [0,T\. 



■2(\K 



9. PREVIOUS METHODS APPLIED TO A SCHRODINGER EQUATION 



In (9.1331 and in the following, C denotes various positive constants which may 



vary from line to line but are independent of T > satisfying (9.411, of t S [0,T] 
and of u £ L 2 (0,T) satisfying J9 105|). 



From (|9_105j), ( |9.108| and ( |9.124| , we get 
(9.134) / f(t, x)ip lx (x)dx + (iS(t)/2) 



^ Ce\S(t)\, t e [0,T]. 



Therefore, using (|9.122|, (|9.132|), (|9.133|) and (|9.134|, we have 
(9.135) 



\V w (t) - S(t)\ ^2w\\<p lx \\ La{I) / \S(r)\dr 

Jo 

+ Ce(\\S\\ LHo , T) + \S(t)\),te[0,T}. 



Let us now estimate V2i(t). From (9.7|, (9.113), (9.123) and using integrations 
by parts, we get 



(9.136) 



2V 21 



(0(2ipi + 4x(pi x ) + u9x \p\)dx. 



From ( |9.105| , ( |9.124| , ( |9.128| , ( |9.132[ ) and ( |9.133| , we get 

^ilU=(/ ; C) ^Ce, ie[0,T]. 



(9.137) 



ll«>(*, 



Using (9.7 1, one easily checks that 
(9.138) 



<p\(2ipx + 4xtpi x )dx = 0, 



which, together with (|9_105j), ( |9.136[ ) and ( |9.137| , leads to 
(9.139) 



\V 2 i(t)\^Ce, te [0,T\. 



From (9.1211, (9.1351 and (9.139), one gets 



(9.140) \V(T)-\\S\\ 2 L2 ^ T) \^7ry lx \\ LHI) 



\S(t)\dt 



> [ Y T + Ce)\\S\\i HQtT) . 



Ce\\Sf 



L 2 (0,T) 



(Note that ( |9.140| is similar to ( |3.108| .) Since 

(V(T) + 0) => (8(T, •) ^ ^) =► (V(T, •) ^ Vi(T, •)), 
this concludes the proof of Theorem |9.8| 



Let us end this section with two open problems and a remark 

on page 



Looking at our result (Theorem 6.24 



205 I on the the 1-D tank control 



system (see Section 6.3), one may state the following open problem. 



Open Problem 9.18. Is it possible to remove assumption (9.41) in Theorem 



9.8? 



Note that Theorem 6.24 on page 205 tells us that Open Problem 9.18 adapted 
to the 1-D tank control system has a negative answer. Note, however, that, for 
a natural adaptation to the Euler equations of incompressible fluids, the answer 
to Open problem |9.18| is in general positive, at least for strong enough topologies. 
More precisely, with the notations of Section |6.2.1[ even with T = d£l but with 
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CI (£ do, given T > and k € N \ {0}, there exists e > such that, for every 
r) > 0, there exists y° € C (CI) vanishing in a neighborhood of dCl satisfying the 
divergence free condition (6.27) as well as \\y \\ct>(si) *s V such that there is no 
trajectory (y,p) £ (^([OjT] x CI) of the Euler control system (6.24 1 satisfying 

(9-141) y(0,-)=y°,y(T,-)=0, 

(9.142) ll»(*,-)llci(n)<e»Vt€[0,r|. 

This can be easily checked by looking at the evolution of curl y(t,-) during the 
interval of time [0, T]. 

on page 



Looking at Theorem 9.1 



248 and Theorem 9.8 



on page 



251 



one may 



also ask if one has small-time local controllability with large controls, i.e., 

Open Problem 9.19. Let T > 0. Does there exist r\ > such that, for every 
{i> Q ,S°,D°),{^ 1 ,S 1 ,D 1 )e [SnH 7 (0) {I;C)} xlxl with 

n°-M0)\\HT + \S a \ + \D a \< V , 

ii^-vicniU' + i^i + i-D 1 !^, 

there exists (if),S,D,u) such that 

VGC°([0,T];if 2 ni7 1 (/;C))nC 1 ([0,T];L 2 (/;C)), 

uefl5(o,T), 

SeC 1 ([0,TpeC 2 ([0 ) T]) 1 

( |9~Tj ), ( |9~2| ) and (J9]3| hold, 

(i,(0),S(0),D(0)) = ^°,S Q ,D°), 
(V(T),5(T),D(T)) = (^ 1 ,5 1 ,C 1 )? 
Remark 9.20. Let us consider the following subsystem of our control system 



(|9.1[)-(|9.2[)-(|9.3[): 

(9.143) ip t (t, x) = iil> xx {t, x) + iu(t)x^(t, x), (t, x) e (0, T) x /, 

(9.144) ^(t,-l) = iP(t,l)=0, te(0,T). 

For this new control system, at time t, the state is tp(t, ■) with J, \ip(t, x) \ 2 dx = 1 and 
the control is u(t) G K. Then (ip, u) := (ipi, 0) is a trajectory of this control system. 
Our proof of Theorem 9.8 can be adapted to prove that the control system (9.143) 
is not small-time locally controllable along this trajectory. Indeed, if S(T) ^ 0, 
then (9.121 ) just has to be replaced by 

S(T) 



(9.145) V(T) 



Note that 



2 I 6(T,x)xip 1 (x)dx + iS(T) / 6(T,x)x I L Pl (x)dx 

T r T 

2 



S(t)V 20 (t)dt- 



o 



s(tyv 2 i(t)dt. 



n 



(pi(x)xipi(x)dx = 0, 



3? ( i I (fi(x)x ipi(x)dx 
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Hence, in every neighborhood of <p\ for the iJ 7 -topology (for example) there exists 
9i in this neighborhood such that 



(9.146) 

(9.147) 
(9.148) 
(9.149) 



i(x)xipi(x)dx = 0, 



3? I i / 9x{x)xf(px{x)dx I - o. 

0ieSnff ( 7 o) , 



)f 



-i + i 9i(x)ip 1 (x)dx ) < 0. 



Moreover, it follows from our proof of Theorem 9.8 that, if (9.41) holds, then 
there exists e > such that, for every 0% £ L 2 (I;C) satisfying (9.1461, (9.147) 
and (9.1491, there is no u € L 2 (0, T), sa tisfyi ng ( 9.105), such that the solution 
ip e C^JJO^T]; L 2 {I; C)) of J9.106|), fl9.107| and (|9.109| satisfies ^(T, •) = e - lAlT 6>i. 



Part 3 

Stabilization 



The two previous parts dealt with the controllability problem, which asks if 
one can move from a first given state to a second given state. The control that one 
gets is an open-loop control: it depends on time and on the two given states, it 
does not depend on the state during the evolution of the control system. In many 
practical situations one prefers closed-loop controls, i.e., controls which do not 
depend on the initial state but depend, at time t, on the state x at this time which 
(asymptotically) stabilizes the point one wants to reach. Usually such closed-loop 
controls (or feedback laws) have the advantage of being more robust to disturbances. 
The main issue of this part is the question of whether or not a controllable system 
can be (asymptotically) stabilized. 

This part is divided into four chapters which we will briefly describe. 



Chapter |10[ This chapter is mainly devoted to the stabilization of linear control 
systems in finite dimension. We first start by recalling the classical pole-shifting 

A consequence of this theorem is that every 

This 



theorem (Theorem 10.1 



on page 
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controllable linear system can be stabilized by means of linear feedback laws, 
implies that, if the linearized controllable system at an equilibrium of a nonlinear 
control system is controllable, then this equilibrium can be stabilized by smooth 
feedback laws. We give an application to the stabilization of the attitude of a rigid 

on page 



spacecraft (Example 10.15 
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Chapter |11[ The subject of this chapter is the stabilization of finite- dimensional 
nonlinear control systems, mainly in the case where the nonlinearity plays a key 
role. In particular, it deals with the case where the linearized control system around 
the equilibrium that one wants to stabilize is no longer controllable. Then there 
are obstructions to stabilizability by smooth feedback laws even for controllable 
systems. We recall some of these obstructions (Theorem 1 1 1 . 1 1 on page 289 and 



Theorem 11.6 



on page 



292). We give an application to the stabilization of the 



attitude of an underactuated rigid spacecraft (Example 11.3|on page 289 I 



There are two ways to enlarge the class of feedback laws in order to recover 
stabilizability properties. The first one is the use of discontinuous feedback laws. 
The second one is the use of time-varying feedback laws. We give only comments 
and references on the first method, but we give details on the second method. We 
also show the interest of time-varying feedback laws for output stabilization. In 
this case the feedback depends only on the output, which is only part of the state. 



Chapter |12[ In this chapter, we present important tools to construct explicit 
stabilizing feedback laws, namely: 

1. control Lyapunov function (Section 12.1 1, 



damping (Section 12.2) 



homogeneity (Section 12.31, 



averaging (Section 12.4). 
backstepping (Section 12.51 
forwarding (Section 12.6), 



transverse functions (Section 12.7) 



These methods are illustrated on various control systems, in particular the stabi- 
lization of the attitude of an underactuated rigid spacecraft and to satellite orbit 
transfer by means of electric propulsion. 



Chapter |13[ In this chapter, we give examples of how some tools introduced 
for the case of finite-dimensional control systems can be used for stabilizing some 
partial differential equations. We treat four examples: 

1. rapid exponential stabilization by means of Gramians, for linear time- 
reversible partial differential equations, 

2. stabilization of a rotating body-beam without damping, 

3. stabilization of the Euler equations of incompressible fluids, 

4. stabilization of hyperbolic systems. 



CHAPTER 10 



Linear control systems in finite dimension and 
applications to nonlinear control systems 



This chapter is mainly concerned with the stabilization of finite-dimensional lin- 
ear control systems. In Section[l0.1| we recall and prove the classical pole-shifting 



theorem (Theorem 10.1 1. A consequence of this theorem is that every controllable 



linear system can be stabilized by means of linear feedback laws (Corollary 10.12 
on page 281 ). As we will see in Section 10.2 this also implies that, if the linearized 



control system at an equilibrium of a nonlinear control system is controllable, then 
this equilibrium can be stabilized by smooth feedback laws (Theorem 10.14 on 
page 

on page 



We give an application to the stabilization of the attitude of a rigid 

we present a 



spacecraft (Example 10.15 



282). Finally, in Section 10.3 



method to construct stabilizing feedback laws from the Gramian for linear control 
systems. This method will turn out to be quite useful for the stabilization of linear 



partial differential equations (see Section 13.1 1 



10.1. Pole-shifting theorem 

In this section we consider the linear control system 

(10.1) x = Ax + Bu, 

where the state is x g 1", the control is u g M m , and where A g £(R™;R") ~ 
M n>n (R) and B g £(R m ;R™) ~ M n>m (R) are given- 
Let us denote by V n the set of polynomials of degree n in z such that the 
coefficients are real numbers and such that the coefficient of z n is 1. For a matrix 
M g .A4„ : „(C), let us recall that Pm denotes the characteristic polynomial of M: 

P M {z) :=det (zI-M). 

Then one has the classical pole-shifting theorem (see, e.g., [290, Theorem 3.1, page 
198] or [4581 Theorem 13, page 186]). 



Theorem 10.1. Let us assume that the linear control system (10.1) is control- 
lable. Then 

{Pa+bk; K g M m , n (R)} = V n . 



Theorem 10.1 is due to Murray Wonham [504]. See [4581 Section 5.10, page 
256] for historical comments. 

Proof of Theorem 110.11 Let us first treat the case where the control is 
scalar, i.e., the case where m = 1. The starting point is the following lemma, which 
has its own interest. 

Lemma 10.2 (Phase variable canonical form or controller form). Let us assume 
that m = 1 and that the linear control system (10.1) is controllable. Let us denote 
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by ai,.. 


,a 


a the n real numbers such that 




(10.2) 

T ei 




n-l 

P A (z) = z n -J2^+iz\ 

i=0 








( 1 
1 


... 0\ 





^°\ 


A 


= 






G M„,„(K), B := 











1 











\ai a 2 ... 


«n-l «n/ 




\V 



G M„j( 



("TTie matrix A is called a companion matrix.) Then there exists an invertible matrix 
S G M n ,nQ&) such that 

(10.3) S- 1 AS = A,S~ 1 B = B. 

Proof of Lemma [T0T2I Let (A, . . . , /„) € (M") n be defined by 



(10.4) 



Then 



(10.5) 



J a 

fn-1 
fn-2 



B, 

Af n - a n B, 

Af n -i - a n _ ± B = A 2 B - a n AB - a„_i-B, 



Ah ~ a 2 B = A n ~ x B - a n A n - 2 B 

- a n -iA n - 3 B - ... - a 3 AB - a 2 B. 



Af n ~- 


Jn—1 < Q-njni 


Af n -! ~- 


= fn-2 + OLn-lfni 


A fn-2 ~- 


= fn-3+ 0<n-2fn, 



Ah 



A n B - a n A n - l B 



011AB = ot\B. 



The last equality of (10.51 comes from the Cayley-Hamilton theorem and (10.21. 

,n-l}. 



By (10.4 1, an easy induction argument on k shows that 

A k B G Span {ff, j G {n - k, . . .,n}} , Vfc G {0, 



(10.6) 

In particular, 

(10.7) Span {A k B; k G {0 



1}} cSpan {f,j- je{l,...,n}} 



Since the control system x = Ax + Bu is controllable, the left hand side of (10.7) 
is, by Theorem 1.16 on page^l equal to all of K™. Hence, by ( 10.T I , (/1, . . . , /„) is 
a basis of W 1 . We define S G M n , n (M) by requiring that 

Set := h, ie{l,...,n}, 

where (ei, . . . , e„) is the canonical basis of R™. Then S is invertible and we have 



(10.31. This concludes the proof of Lemma 10.2 
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Let us go back to the proof of Theorem 1 1 . 1 1 when m = 1. Let P G V n . Let us 
denote by /?i, . . . ,/3 n the n real numbers such that 



(10.8) 



P{z) = z n -Y J ^+i' 



Let us also denote by a\, ■ . ■ , a n the n real numbers such that 



(10.9) 
Let 

We have 



Pa{z) = z n - ^2a i+1 ; 



i=0 



K := (/?i -ai,...,/?„ -a n ) G Mi,„( 



/0 1 
1 







... 1 
V/3i /3 2 ... /3„-i /?„/ 
Then, with an easy induction argument on n, one gets 

n-l 



i=0 



Therefore, if we let if := 7^5 1 , 



Pa+BK — Ps~ 1 {A+BK)S — Pa+BK ~ P > 



which concludes the proof of Theorem 1 1 0. 1 1 if m = 1 . 



Let us now reduce the case m > 1 to the case m = 1. The key lemma for that 
is the following one due to Michael Heymann [232j. 

Lemma 10.3. Let us assume that the control system x = Ax+Bu is controllable. 
Then there exist f G .M m i(R) and C G A / ! mjn (K) such that the control system 



± = (A + BC)x + Bfu, ieK",«eI, 



is controllable. 



Postponing the proof of Lemma |10.3[ let us conclude the proof of Theorem |10.1| 
Let P G V n . Let / G M„ u i(R) and C G M m , n (R) be as in Lemma |10.3| Applying 



Theorem 10.1 to the single-input controllable control system x = (A+BC)x + Bfu, 
there exists K\ G A / !i : n(R) such that 



Pa- 



BC+BfKi 



P. 



Hence, if K := C + fK u then 

Pa+bk = P- 
This concludes the proof of Theorem |10.1| 
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Proof of Lemma 

be such that 

(10.10) 



10.3 



We follow Matheus Hautus [2l8] . Let / E M m ,i(l 



B//0. 



Such an / exists. Indeed, if this is not the case, B = and the control system 
x = Ax + Bu is not controllable, in contradiction to the assumptions made in 



Lemma 10.3 (Note that (10.10 1 is the only property of / that will be used.) We 
now construct by induction a sequence (#j)jg{i ...m in the following way. Let 

(10.11) x 1 :=Bj. 
Let us assume that (xi^g-n...^-} is constructed. If 

(10.12) Axj ■ + BR m C Span {xi,...,Xj}, 

we take k := j. If (10.12) does not hold, we choose Xj+\ in such a way that 
(10.13) 



Cj+i £ Span {xi,...,Xj} 



(10.14) 



x J+ i 



£ Ax-j 



(Of course .£j+i is not unique, but, since (10.12) does not hold, there exists such 
an x j+1 .) Clearly (see ( |10.10[ ), ( |10.11[ ) and ( |10.13[ )), 

(10.15) the vectors xi,...,Xk are independent and k < n. 
Let 

(10.16) E := Span {x 1 ,...,x k } C R n . 
Let us check that 

(10.17) E = K n and thus k = n. 



Since "aifc+i does not exist", we have, by (10.121, 
(10.18) Ax k + BueE,\/ue 



Taking u = in (10.18), we get Ax k € E, which, using (10.18) once more, gives us 
(10.19) BR m C E. 



Note also that, by (10.14), 



Axj e Xj + i + 



Vj € {1, 



1}, 



which, together with ( |10.16[ ), ( |10.18[ ) and ( |10.19| , shows that 
(10.20) AEcE. 



From ( |10.19| and ( |10.20| , we get 
(10.21) Span {A^u; u e 



ie{0, 



1}}CE. 



But, using the Kalman rank condition (Theorem 1.16 on page^l, the controllability 
of x = Ax + Bu implies that 



Span {A l Bu; u e K m , i e {0, 



1}} 



which, together with (10.15) and (10.211, implies (10.171 



By (10.14), for every j E {1, 
(10.22) x 



j'+i 



. , n — 1 } , there exists Uj G K m such that 
Axj + Biij. 
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L'V!) 



Let C G M m ,n( 
(10.23) 



be such that 

Cx 3 = 



'.r 



Vj g {l, 



!}• 



By (10.151 such a C exists (C is not unique since Cx n is arbitrary). We have 

(A + BC)xi = Ax x + Bui 



X2 



and more generally by induction on i, 

(10.24) (A + BC) i x 1 = x i+1 , Vi G {0, . . . , n - 1}. 

From the Kalman rank condition (Theorem 1.16 on pagep)]), (10. Ill, (10.161 and 
(10.171, the control system x = (A + BC)x + Bfu, u 6 lis controllable. This 



concludes the proof of Lemma |10.3| 



Exercise 10.4. Let us assume that there exists K G _A/! mi „(R) such that A + 
BK has only eigenvalues with strictly negative real parts. Let us also assume that 
there exists K G M m „(R) such that A + BK has only eigenvalues with strictly 



positive real parts. Prove that the linear control system (10.1) is controllable. (Lt 



has been proved by David Russell in [425 that this property also holds for infinite- 
dimensional control systems and has important applications in this framework.) 



Remark 10.5. It follows from the proof of Theorem 10.1 that, if m = 1 (single- 
input control) the controllability of x = Ax + Bu implies that, for every P G 
V n , there exists one and only one K G M m ^ n (M) such that Pa+bk = P- The 
uniqueness is no longer true for m ^ 2. 



10.2. Direct applications to the stabilization of finite-dimensional 

control systems 

Let us first recall the definition of asymptotic stability for a dynamical system. 

Definition 10.6. Let £1 be an open subset of R™ and let x e G f2. Let X in 
C°(ft;R") be such that 

X(x e ) = 0. 

One says that x e is locally asymptotically stable for x = X(x) if there exists 8 > 
such that, for every e > 0, there exists M > such that 

(10.25) x = X(x) and \x(0) - x e \ < 5 
imply 

(10.26) \x(t) - x e \ < e, Vr > M. 

If £1 = R" and if, for every 5 > and for every e > 0, there exists M > such that 



(10.251 implies (10.261, then one says that x e is globally asymptotically stable for 



X(x). 



Throughout this chapter, and in particular in (10.25), every solution of x 



X(x) is assumed to be a maximal solution of this differential equation. 

Let us emphasize the fact that, since the vector field X is only continuous, the 
Cauchy problem x = X(x),x(to) = Xq, where t and x$ are given, may have many 
maximal solutions. 
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Remark 10.7. Jaroslav Kurzweil has shown in [289] that, even for vector fields 
which are only continuous, asymptotic stability is equivalent to the existence of a 
Lyapunov function of class C°°; see also [99 by Francis Clarke, Yuri Ledyaev, and 
Ronald Stern. 

Let us recall some classical theorems. The first one gives equivalent properties 
for asymptotic stability. (In fact, one often uses these properties for the definition 



of asymptotic stability instead of Definition 10.6 on the preceding page.) 



Theorem 10.8. Let f2 be an open subset of K n and let x e G f2. Let X in 

C a {n-,R n ) be such that 

X(x e ) = 0. 

The point x e is locally asymptotically stable for x = X(x) if and only if the two 

following properties (i) and (ii) are satisfied: 

(i) x e is a stable point for x = X(x), i.e., for every e > 0, there exists r\ > such 

that 

(x = X(x) and \x(0) - x e \ < 77) => (\x(t) - x e \ < e, Vt ^ 0). 
(ii) x e is an attractor for x = X{x), i.e., there exists p > such that 
(x = X(x) and \x(0) — x e \ < p) =$■ ( lim x(t) = x e ). 

t — >+oo 

The point x e is globally asymptotically stable for x = X(x) if and only if x e is a 
stable point for x = X(x) and 

(x = X(x)) => ( lim x(t) = x e ). 

t — >+oo 

The next theorem deals with the case of linear systems. 

Theorem 10.9. (See, for example, [273| Theorem 3.5, Chapter 3, page 124] 
or [4581 Proposition 5.5.5, Chapter 5, page 212].j Let A e £(R";R"). Then is 
locally asymptotically stable for the linear differential equation x = Ax if and only 
if every eigenvalue of A has a strictly negative real part. 

The last theorem is a linear test which gives a sufficient condition and a neces- 
sary condition for local asymptotic stability. 

Theorem 10.10. (See, for example, [2731 Theorem 3.7, Chapter 3, pages 130- 
131].j Let n be an open subset of R" and let x e e tt. Let X G C^fyR") be 
such that X(x e ) = 0. // every eigenvalue of X'{x e ) has a strictly negative real 
part, then x e S R" is locally asymptotically stable for x = X(x). If X'(x e ) has an 
eigenvalue with a strictly positive real part, then x e is not stable for x = X(x) (see 



(i) of Theorem 10.8 for the definition of stable point) and therefore x e is not locally 



asymptotically stable for x = X(x). 

Let us now go back to our general nonlinear control system 

(C) x = f(x,u), 

where the state is x G E™, the control is u G M. m and the function / is of class C 1 
in a neighborhood of (0,0) G R™ x R m and such that /(0,0) = 0. We now define 
"asymptotic stabilizability by means of a continuous stationary feedback law" . 
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Definition 10.11. The control system (C) is locally (resp. globally) asymp- 
totically stabilizable by means of continuous stationary feedback laws if there exists 
u G C°(R";R m ), satisfying 

u(0) = 0, 

such that G R n is a locally (resp. globally) asymptotically stable point, for the 
dynamical system 

(10.27) x = f(x,u(x)). 



(The dynamical system (10.27) is called a closed-loop system.) 



Note that we should in fact say, "The control system (C) is locally (resp. glob- 
ally) asymptotically stabilizable by means of continuous stationary feedback laws at 
the equilibrium (x e ,u e ) := (0,0) G R™ x R m ". But, without loss of generality, 
performing a translation on the state and the control, we may assume that the 
equilibrium of interest is (x e ,u e ) := (0,0) G R n x R m . Hence we omit "at the 



equilibrium". In contrast, we mention "stationary" since later on (in Section 11.2) 
we will consider time-varying feedback laws. 



As a direct consequence of the pole-shifting theorem (Theorem 10.1) and of 



Theorem 10.9 we have the following corollary. 



Corollary 10.12. Let us assume that the linear control system (10.1) is 
controllable. Then there exists a linear feedback law x € R n i— > Kx € R m , 
K € M. m n(R), such that G R™ is globally asymptotically stable for the closed-loop 



system x = Ax + BKx. In particular, every linear controllable system (10.1) is 



globally asymptotically stabilizable by means of continuous stationary feedback laws. 

Remark 10.13. In practical situations, the choice of K is crucial in order to 
have good performances for the closed-loop system x = Ax + BKx. In general, one 
desires to have robust feedback laws for uncertain linear control systems. There are 
many tools available to deal with this problem. Besides classical Riccati approaches, 
let us mention, in particular, 

1. H°° control; see, for example, the books [36j by Tamer Ba§ar and Pierre 
Bernhard, [219 by William Helton and Orlando Merino, [383] by Ian 
Petersen, Valery Ugrinovskii and Andrey Savkin; 

2. /i analysis; see, for example, the book [339J by Uwe Mackenroth; 

3. CRONE control, due to Alain Oustaloup [379] , 

Let us now prove the following fundamental theorem. 

Theorem 10.14. Let us assume that the linearized control system 

df df 

(10.28) x= ^(0,0)x+ ^(0, 0)« 

is controllable. Then there exists K G M m ,n($) such that G R n is locally asymp- 
totically stable for the closed-loop system x = f(x,Kx). In particular, the control 
system (C) is locally asymptotically stabilizable by means of continuous stationary 
feedback laws. 

Proof of Theorem |10.14[ By the pole-shifting Theorem |10.1| on page |275| 



applied to the linear controllable system (10.281, there exists K G VW m! „(R) such 
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that 
(10.29) 
Let X : x e 



df df 

the spectrum of — (0,0) + •— — (0, 0)K is equal to {— 1}. 
ox on 

-> X{x) £ W 1 , be defined by 

X(x):=f(x,Kx). 



Then X(0) = and, by (|10.29|) 
(10.30) 



the spectrum of X' (0) is equal to {— 1}. 



Theorem 10.10 and (10.301 imply that G R™ is locally asymptotically stable for 
x = X(x) = f(x,Kx). This concludes the proof of Theorem 10.14 ■ 



Example 10.15. Let us go back to the control of the attitude of a rigid spacecraft 
with control torques provided by thruster jets, a control system that we have already 
considered in Example 3.9\ on page \128\ and Example \3.35\ on page \144\ Hence our 
control system is (3.12) with b±, . . . , b m independent. Here we take m = 3. In this 



case, as we have seen in Example 3.9 on page 128 the linearized control system of 
(3.12) at the equilibrium (0,0) 6 M 6 x K 3 is controllable. Hence, by Theorem 10.14 
there exists K € M.%,6 (K) such that € K 6 is locally asymptotically stable for the 
associated closed-loop system x = f(x,Kx). 



One can find many other applications of Theorem |10.14| to physical control 
systems in various books. Let us mention in particular the following ones: 

- |19j by Brigitte d'Andrea-Novel and Michel Cohen de Lara, 

- [179 by Bernard Friedland. 

10.3. Gramian and stabilization 



The pole-shifting theorem (Theorem 10.1 



on page 



275 I is a quite useful method 



to stabilize finite- dimensional linear control systems. But for infinite-dimensional 
linear control systems, it cannot be used in many situations. In this section we 
present another method, which has been introduced independently by Dahlard 
Lukes [336 and David Kleinman [275J to stabilize finite-dimensional linear con- 
trol systems, and which can be applied to handle many infinite-dimensional linear 
control systems. For applications to infinite- dimensional linear control systems, see, 
in particular, the papers [450] by Marshall Slemrod, [278j by Vilmos Komornik 



and [490 by Jose Urquiza, as well as Section 13.1 
We consider again the linear control system 

(10.31) x = Ax + Bu, 

where the state is x € K™ and the control is u G K m . Let T > 0. Throughout this 
section, we assume that this linear control system is controllable on [0,T]. Let us 
recall that, as pointed in Theorem 1 1 . 1 6 1 on page [91 this property in fact does not 
depend on T > 0. By Definition 1 1 . 1 0| on page [6) the controllability Gramian of 
the linear control system ( 10.31 ) on the time interval [0, T] is the n x n symmetric 
matrix £ defined by 

(10.32S (!•:= f T eV-^BB^eV-Wdt. 
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2,\:i 



This symmetric matrix is nonnegative and, in fact, by Theorem 1 1 . 1 1 1 on page[6j 

(10.33) £ is positive definite. 

Let 



(10.34) 



C 



e~ TA €e- TAt1 ' 



e- tA BB u e' tAtI dt. 



Clearly, Ct is a symmetric matrix. By (10.33) and (10.341, 

(10.35) Ct is positive definite. 
Let K e £(R";R m ) be defined by 

(10.36) K:=-B tT C T x . 

Then one has the following theorem due to Dahlard Lukes [336, Theorem 3.1] and 
David Kleinman |275] . 

Theorem 10.16. There exist [i > and M > such that, for every (maximal) 
solution of x = (A + BK)x, 

(10.37) \x{t)\ < Me-^KO)!, Vi > 0. 



Proof of Theorem 10.16 Since the system x = (A + BK)x is linear, it 
suffices to check that every (maximal) solution x : R — > R n of x = {A + BK)x 
satisfies 



(10.38) 








lim x(t) = 0. 

t-^-\-oo 




Thus, let x 


:R- 


R" be 


a (maximal) solution of 




(10.39) 






i 


• = {A + BK)x 




Let V : l n 


-> [0,+oo) be 


defined 


by 




(10.40) 






V(z): 
V(z)> 


= z u C^ x z, Vz 
V(0), Vz e R" 


el". 


By (10.351, 




(10.41) 


\{0}, 


(10.42) 






V(z)- 


-» +oo as \z\ — » 


+oo. 


Let v : R -> 


Rbe 


defined 


by 






(10.43) 






v(t) 


:= V(x{t)), Vi ( 


ER. 



From (10.361, (10.391, (10.401 and (10.43), we have 



(10.44) v 



\tj \^rp X\ ~~T~ X l\ l^>rp X ~T~ X \^/rji J\X X O fTi D _D O rp X. 



From (10.341 and an integration by parts, we get 

(10.45) AC T = -e' TA BB tr e- TAtr + BB tT - C T A tr . 



Multiplying (10.45 I on the right and on the left by C T , one gets 

(10.46) C^A = -C T - 1 e- TA BB tr e - TAt ' Ct 1 + C^BB^'C^ 1 - A tr C^\ 



From (10.441 and (10.461, one gets 



(10.47) 



\B"C~ l x 



1„|2 



lB* e -TA« c -l x ^ 
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By (10.41), (10.42) and the LaSalle invariance principle (see, for example, [458 
Lemma 5.7.8, page 226]), it suffices to check that, if 

(10.48) v(t) = 0, Vi € R, 
then 

(10.49) ai(0)=0. 



Let us assume that (10.481 holds. Then, using (10.471, 
(10.50) B tT C^ l x(t) = 0, Vi e R, 

(10.51) 



B* t e- TAtr Cz 1 x(t) = 0,Vte 



From fll0.36| , ( |10.39| and ( |10.50[ ), we get 
(10.52) 



x(t) = Ax(t), Vi G 



Differentiating (10.501 with respect to time and using (10.521, one gets 
(10.53) B^C^Axit) = 0, Vi e R. 

Using ( |10.46[ ), ( |10.50[ > and ( |10.51| , we get 



(10.54) 



4 tr Cf ^(i), Vi e 



which, together with (10.53), gives 



B tT A tT C^ 1 x(t) = 0, Vt e 



Then, using (10.52) and (10.541, an easy induction argument shows that 



and therefore 
(10.55) 



B tI (A tT ) i CT 1 x(t) = 0, Vi e R, V* e N, 



xWCt'A'B = 0, Vi e R, Vi e {0, 



!}• 



From (10.551 and the Kalman rank condition (Theorem 1.16 on page^l, one gets 



that x(t) tr C T = and therefore x(t) = 0, for every ( 6 I. This concludes the 



proof of Theorem 10.16 



Let us now try to construct a feedback which leads to fast decay. More precisely, 
let A > 0. We want to construct a linear feedback x € R" h-> K\x € R m , with 
K x e £(R"; R m ) such that there exists M > such that 

\x(t)\ < Me -A *|a;(0)|, Vt e [0,+oo), 



(10.56) 

for every (maximal) solution of x 



(A + BK\)x. Note that the existence of 
such a linear map K\ is a corollary of the pole-shifting theorem (Theorem 10.1 on 
page 275). However, we would like to construct such a feedback without using this 

Then x 



theorem. The idea is the following one. Let y := < 
equivalent to 

(10.57) y = (A + Xld n )y + Bv 



xt„ 



Ax + Bu is 



ue 



M 



Let us consider ( 10.57 ) as a control system where the state is y € 



with v 

and the control is v G R m . The controllability of the control system x = Ax + Bu is 

equivalent to the controllability of the control system y = (A + XId n )y + Bv. This 



can be seen by using the equality y 



-Xt 



x or by using the Kalman rank condition 
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(see Theorem 1.16 on pagepjj). We apply Theorem 10.16 to the controllable control 
system y = (A + AId„)y + Bv. Let us define K\.t € ■Mm,n(^) by 



(10.58) 



K 



\,T 



-B tr 
-B t 



r (£ 



e -2\t e -tA BB tr e -tA* dt 



Then, by Theorem 10.16 there exists M > such that 

(10.59) |y(i)|<M|y(0)|,Vt€ [0,+oo), 

for every (maximal) solution of the closed-loop system y = (A + AId„ + BK\j^)y. 
Now let x : [0, +oo) — ► R n be a solution of the closed-loop system x = (A+BK\^t)x. 
Then y : [0, +oo) —> R n defined by y{t) := e xt x{t), t £ [0, +oo) is a solutio n of the 
closed-loop system y = (A + AId„ + BK\j<)y- Hence we have (10.591, which, 
coming back to the x variable, gives (10.56). This ends the construction of the 
desired feedback. 

Note that the convergence to can be better than the one expected by (10.56) 
and one can take T = oo in ( 10.34 |; this leads to a method called the Bass method 
by David Russell in [4271 pages 117-118]. According to [42 7j . Roger Bass in- 
troduced this method in "Lecture notes on control and optimization presented at 
NASA Langley Research Center in August 1961". Let us explain how this method 
works (and how one can prove a better convergence to than the one expected by 
fll0.56| , at least if T > is large enough). For L G £(R n ;R n ), let us denote by 
o~(L) the set of eigenvalues of L and let 

n(L) :=Max{3?C; Ce v(L)}- 

(Let us recall that, for zeC, 5Rz denotes the real part of z.) Let A € (fi(—A), +00). 
Let C A ,oo € £(M™;R n ) be defined by 



(10.60) 



C\ 



-2Xt e -tA BB tr e -tA" dL 



Note that C\,oo is a nonnegative symmetric matrix. Moreover, 

»1 



(10.61) 



x ^A.oc 



x > e 



-2 Max {0,A} tr 



- tA BB tr e~ tAtr 



dt I x, \/x € 



Since the control system x = Ax + Bu is assumed to be controllable, by Theo- 
rem |1 . 1 1 1 on page [6] and Remark |1 . 12 1 on page [7] there exists c > such that 
•1 



I e~ tA BB t,c e- tAtT dt\ x > c\x\ 2 , Vx e R n , 



which, together with (10.61 1, implies that the symmetric matrix Ca,oo is invertible. 
We define K\ ^ 



K 



A. 00 



e£(I 



-B t 



n. R mj by 

(jo°° e-W+x^BB^i "-V + M.i,. , f// 



(10.62) = _ B tr^ e -2Xt e -tA BB fc e -tA^ dt \ 

Then one has the following proposition, proved by Jose Urquiza in [490 . 
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Proposition 10.17. Let A e (fi(— A), +oo). Then 
(10.63) a{A + BKx.oo) = {-2A - C; C € a(A)}. 



(10.64) 
(Comp 
(10.65) 



Proof of Proposition 10.17 From (10.60) and an integration by parts 
(A + AId„)C Ai00 + C x ,oo{A + AId„) tr = BB^. 



(Compare with ( 10.45 I.) Let us multiply ( 10.64 I from the right by C x . One gets 



(A + AId„) + C AiOC (A + AId n ) tr C7^ = BB^C^. 



From (10.621 and (10.651, one gets 

A + BK Koo = C A;00 (-A tr - 2AId n )C A -^ , 



(10.66) 



which gives (10.631. This concludes the proof of Proposition 10.17 



As a consequence of (10.66), one has the following corollary which has been 



pointed out by Jose Urquiza in [490j (compare with (10.56)). 
Corollary 10.18. Assume that 

(10.67) A tr = -A. 

Let A > 0. Then there exists M e (0,+oo) such that, for every (maximal) solution 
ofx={A + BK x , 00 )x, 

\x(t)\ < Me- 2Xt \x(0)\, Vi^s 0. 
Proof of Corollary 10.18, Let x : [0, +oo) — > K™ be a (maximal) solution of 

(10.68) x = (A + BKx,oo)x. 

Let y : [0, +oo) -» 1" be defined by 

(10.69) y(t):=<7rL*(*)»*e[0,+oo). 



From fll0.66| , ( |10.68| and ( |10.69[ ), one gets that 
(10.70) y = -(A tr + 2AId„^. 



From (10.671 and (10.701, we have 



d I |2 



-4A|j/| 2 , 



which implies that 
(10.71) 



|y(i)| = e- 2At |y(0)| > Vte[0,+oo). 



From ( |10.69| ) and (|10_71| , one gets that 
\x(t)\^\\C Xt00 \\co*>i*-)\\<Z-LU( 



-2Xt 



x(0)|, Vie [0,+oo), 



which concludes the proof of Corollary |10.18| 



CHAPTER 11 



Stabilization of nonlinear control systems in finite 

dimension 



Let us recall (Corollary 10.12 on page 2811 that, in finite dimension, every lin- 
ear control system which is controllable can be asymptotically stabilized by means 
of continuous stationary feedback laws. As we have seen in Section [10.2| this result 
implies that, if the linearized control system of a given nonlinear control system is 
controllable, then the control system can be asymptotically stabilized by means of 
continuous stationary feedback laws; see Theorem |10.14| on page |281| A natural 
question is whether every controllable nonlinear system can be asymptotically sta- 
bilized by means of continuous stationary feedback laws. In 1979, Hector Sussmann 
showed that the global version of this result does not hold for nonlinear control sys- 
tems: In [467 , he gave an example of a nonlinear analytic control system which 
is globally controllable but cannot be globally asymptotically stabilized by means 
of continuous stationary feedback laws. In 1983, Roger Brockett showed that the 
local version also does not hold even for analytic control systems: In [74] he gave a 



necessary condition (Theorem 1 1 1 . 1 1 on page 289) for local asymptotic stabilizability 



by means of continuous stationary feedback laws, which is not implied by local 
controllability even for analytic control systems. For example, as pointed out in 
|74j . the analytic control system (also called the nonholonomic integrator) 

(11.1) ±1 = Ml, ± 2 = U 2 , X 3 = XiU 2 - X 2 Ui, 

where the state is x = (x\, X2, £3) tr G K 3 and the control is u = (ui,U2) tT G K 2 , is 



locally and globally controllable (see Theorem 3.19 on page 135 and Theorem 3.18 
on page 134) but does not satisfy the Brockett necessary condition (and therefore 
cannot be asymptotically stabilized by means of continuous stationary feedback 
laws). To overcome the problem of impossibility to stabilize many controllable 
systems by means of continuous stationary feedback laws, two main strategies have 
been proposed: 

(i) asymptotic stabilization by means of discontinuous feedback laws, 
(ii) asymptotic stabilization by means of continuous time-varying feedback 
laws. 

In this chapter, we mainly consider continuous time- varying feedback laws. We 
only give bibliographical information on the discontinuous feedback approach in 
Section |11.4| Let us just mention here that the main issue for these feedbacks is 
the problem of robustness to (small) measurements disturbances (they are robust 
to (small) actuators disturbances). 

For continuous time-varying feedback laws, let us first point out that, due to a 
converse to Lyapunov's second theorem proved by Jaroslav Kurzweil in [289] (see 
also [99]), periodic time- varying feedback laws are robust to (small) actuators and 
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measurement disturbances. The pioneering works concerning time- varying feedback 
laws are due to Eduardo Sontag and Hector Sussmann [460j, and Claude Samson 
[435 . In [460 1, it is proved that, if the dimension of the state is 1, controllability 
implies asymptotic stabilizability by means of time- varying feedback laws. In 435 , 
it is proved that the control system ( |11.1| can be asymptotically stabilized by means 
of time-varying feedback laws. In Sections |11.2.1| and |11.2.2| we present results 
showing that, in many cases, (local) controllability implies stabilizability by means 
of time- varying feedback laws. 

In many practical situations, only part of the state — called the output — is mea- 
sured and therefore state feedback laws cannot be implemented; only output feed- 
back laws are allowed. It is well known (see, e.g., [458| Theorem 32, page 324]) 
that any linear control system which is controllable and observable can be asymp- 
totically stabilized by means of dynamic feedback laws. Again it is natural to ask 
whether this result can be extended to the nonlinear case. In the nonlinear case, 
there are many possible definitions for observability. The weakest requirement for 
observability is that, given two different states, there exists a control 1 1— > u(t) which 
leads to maps "t <— > output at time t" which are not identical. With this definition 
of observability, the nonlinear control system 



2 



(11.2) x = u, y = x 

where the state is x G R, the control «6l, and the output y € K, is observable. 
This system is also clearly controllable and asymptotically stabilizable by means of 
(stationary) feedback laws (e.g. u{x) = —x). But, see [107] . this system cannot be 
asymptotically stabilized by means of continuous stationary dynamic output feed- 
back laws. Again, as we shall see in Section |11.3| the introduction of time- varying 



feedback laws improves the situation. In particular, the control system (11.2) can 



be asymptotically stabilized by means of continuous time- varying dynamic output 



feedback laws. (In fact, for the control system (11.21, continuous time-varying 
output feedback laws are sufficient to stabilize asymptotically the control system.) 
Let us also mention that the usefulness of time- varying controls for different 
goals has been pointed out by many authors. For example, by 

1. V. Polotskii [386 for observers to avoid peaking, 

2. Jan Wang [498 1 for decentralized linear systems, 

3. Dirk Aeyels and Jacques Willems [4 for the pole-shifting problem for linear 
time-invariant systems, 

4. Pramod Khargonekar, Antonio Pascoal and R. Ravi [274 , Bertina Ho- 
Mock-Qai and Wijesuriya Dayawansa 235| for simultaneous stabilization 
of a family of control systems, 

5. Nicolas Chung Siong Fah [157J for Input to State Stability (ISS), a notion 
introduced by Eduardo Sontag in [454j in order to take care of robustness 
issues. 

See also the references therein. 

11.1. Obstructions to stationary feedback stabilization 

As above, we continue to denote by (C) the nonlinear control system 
(C) x = f(x,u), 
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where x G W 1 is the state and u G R m is the control. We again assume that 

(11.3) /(0,0)=0 

and that, unless otherwise specified, / € C°°(0;R"), where O is an open subset of 
R n x R m containing (0,0). 

Let us start by recalling the following necessary condition for stabilizability due 
to Roger Brockett [74 . 

Theorem 11.1. If the control system x = f(x,u) can be locally asymptotically 
stabilized by means of continuous stationary feedback laws, then the image by f of 
every neighborhood of (0, 0) G R n x R m is a neighborhood o/O G l n . 

Example 11.2 (This example is due to Roger Brockett [74]). Let us return to 
the nonholonomic integrator 



(11.4) 



Ml, X 2 = U 2 , X 3 = X X U 2 - X 2 Ui. 



It is a driftless control affine system where the state is (xi,X2,x^) tr G R 3 and 



the control is (tii,^)' 



As we have seen in Example 



3.20 



on page 



135 



1 1 



follows from Theorem \3.1B\ on page \135\ that this control system is small-time locally 
controllable at the equilibrium (x e ,u e ) = (0,0) G R 3 x R 2 (see also Example 
page 



6.3 on 



190 for a proof based on the return method). However, for every r\ G R \ {0}, 



the equation 



Ui = 0, u 2 = 0,XiU 2 



x 2 ui = 77, 

has no solution. 



Hence, the non- 



where the unknown are (xi,X2,ui,U2) tr G 
holonomic integrator does not satisfy Brockett 's condition and therefore, by The- 
orem 1 1 1. 1\ it cannot be locally asymptotically stabilized by means of continuous 
stationary feedback laws. 

Example 11.3. Let us go back to the control system of the attitude of a rigid 



spacecraft, already considered in Example 3.9 on page \128\ Example 3.35 on page 144 
and Example \l . 1 5\ on page \282] One has the following cases. 

1. For m = 3, the control system (3.12) satisfies Brockett's condition. In 
fact, in this case, the control system (3.12) is indeed asymptotically stabi- 
lizable by means of continuous stationary feedback laws, as we have seen in 



Example 10.15 on page 282 (see also [137] and [80 ) 



2. For m G {1,2}, the control system (3.12) does not satisfy Brockett's condi 



(11.5) 
(11.6) 



tion (and so is not locally asymptotically stabilizable by means of continuous 
stationary feedback laws). Indeed, if b G R 3 \ (Span {61,62}), there exists 
no ((ui,r]),u) such that 

S(uj)u + M161 + u 2 6 2 = 6, 
A(r))uj = 0. 



Indeed, (11.6) gives ui 
U\bi + U2&2/ see also 



0, which, together with (11.5), implies that b 



In [508], Jerzy Zabczyk observed that, from a theorem due to Aleksandrovich 
Krasnosel'skh [283] 1284] (at least for feedback laws of class C ; see below for 
feedback laws which are only continuous), one can deduce the following stronger 
necessary condition, that we shall call the index condition. 
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Theorem 11.4. If the control system x = f(x,u) can be locally asymptotically 
stabilized by means of continuous stationary feedback laws, then there exists u G 
C°(W l ;M. m ) vanishing at G R n such that f(x,u(xj) / for \x\ small enough but 
not and the index of x (-» f(x,u(x)) at is equal to (—1)". 

Let us recall that the index of x i— ► X(x) := f(x, u(x)) at is (see, for example, 
EMI page 9]) 

degree (X, {x G K"; \x\ < e}, 0) 
where e > is such that 



(11.7) 



(X(x) = and \x\ < e) => (a; = 0). 



For the definition of degree (X, {x G R n ; |x| < e}, 0), see Appendix |BJ (In fact, with 
the notations in this appendix, we should write 

degree (X| {xeE n.| x | <e} , {a; G R"; \x\ < e},0) 

instead of degree (X, {x G R n ; |a;| < e},0). For simplicity, we use this slight abuse 
of notation throughout this whole section.) Note that, by the excision property 
of the degree (Proposition B.ll on page 388), degree (X, {x G R n ; |x| < e},0) is 



independent of e > provided that (11.7) holds. Let us point out that 

(11.8) degree {X, {x G R"; \x\ < e}, 0) / 
implies that 

(11.9) X{{x G R"; \x\ < e}) is a neighborhood of G R™. 



Indeed, by a classical continuity property of the degree (Proposition B.9 

such that \a\ ^ v, 



on page 



387), there exists v > such that, for every a G 

(11.10) degree (X, {x G R"; \x\ < s},a) exists, 

(11.11) degree (X, {x G K"; |sc| < e}, a) = degree (X, {x G 1"; \x\ < e},0). 



B.10 



on page 



From (11.8), (11.10), (11.11) and another classical property of the degree (Propo- 
sition 



387), we get 



{a G K"; |a| < v} c X{{x G R"; |x| < e}), 



which gives ( 11.9 ). Hence the index condition implies that the image by / of every 
neighborhood of (0, 0) G W 1 x R m is a neighborhood of G 
implies Theorem |11.1| 



Thus Theorem 



11.4 



Proof of Theorem 11.4 



Since G R" is asymptotically stable for x = 
X(x) := f(x, u(x)) 7 there exists £o > such that 

X(x) ^ 0, Va; G R™ such that < \x\ ^ e . 

Let us now give the proof of Theorem |11.4| when X is not only continuous but of 
class C 1 in a neighborhood of G R™ (which is the case treated in |283l [284 ). 
Then one can associate to X its flow $ : R x R n — > R™, (£, x) i— > $(£, x), defined by 



5$ 
~dt 



X($), $(0,a;) 



This flow is well defined in a neighborhood of R x {0} in R x 
let 

B E := {x G R"; \x\ ^ e}, 



For £ G (0,E ], 
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and let H : [0, 1] x B e 

H{t,x) 

H(0,x) 
H(l,x) 



R™ be denned by 



X(x), 
-x, 



t 



V(f,i)e(o,i)xl £ 

Vx e B E , 
Vx g B e . 



Using the hypothesis that is locally asymptotically stable for x = X(x), one 
gets that, for e G (0, £o] small enough, H is continuous and does not vanish on 
[0, 1] x dB e . We choose such an e. From the homotopy invariance of the degree 
on page 



(Proposition B. 
(11.12) 



3871 



degree (if (0, -),B e ,0) = degree (i?(l, -),B e , 0). 



By a classical formula of the degree (see (B.4| on page 380) 



degree (^(1,-), -Be, 0) = degree (-Id„|^, B £ ,0) = (-1)", 

if X is of class 



which, together with (11.12), concludes the proof of Theorem 



11.4 



C 1 in a neighborhood of G R". 

If X is only continuous, we apply an argument introduced in |108j . One first 
uses a theorem due to Jaroslav Kurzweil [289 j which tells us that local asymptotic 
stability implies the existence of a Lyapunov function of class C°°. Hence there 
exist £i e (0,£ ] and V e C°°(B 6l ) such that 



(11.13) 

(11.14) 



V(x)>V(0),\/xeB ei \{0}, 
V7(i) • X(x) <0,\/xe B £l \ {0}. 



Note that ( 11.14 1 implies that 
(11.15) 



W(i)^0,VieB £l \{0}. 



From (11.131 and (11.151, we get that V is a Lyapunov function for x = —\7V(x). 
Hence, G R n is locally asymptotically stable for x = — VV(x). Therefore, by our 
study of the C 1 case, 

(11.16) degree (-W,5 El ,0) = (-l) n . 

Now let h : [0, 1] x B Sl be defined by 

h(t, x) = -tW{x) + (1 - t)X(x), V(i, x) G [0, 1] x B ei . 



From (11.141, one gets 

h(t,x)-VV(x) <0,V(t,x) G [0,1] x (5B ei ). 

In particular, 

(11.17) h(t,x) =£0,V(t,x) G [0,1] x (dB £l ). 

Using (11.171 and once more the homotopy invariance of the degree (Proposition |B . 8] 
on page 



387|), we get 

degree (X,B Sl ,0) 



degree (h(0, -),B ei ,0) 
degree (h(l, -),B ei ,0) 
degree (-W,5 ei ,0), 



which, together with (11.16), concludes the proof of Theorem 11.4 
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It turns out that the index condition is too strong for another natural stabiliz- 
ability notion that we introduce now. 

Definition 11.5. The control system x = f[x,u) is locally asymptotically 
stabilizable by means of dynamic continuous stationary feedback laws if, for some 
integer p G N, the control system 

(11.18) x = f{x,u),y = v eR p , 

where the control is (u,v) tT G R m +P w ith (u,v) G R m x R p , and the state is 



{x,yf 



pn+p 



with (x,y) G 



is locally asymptotically stabilizable by 



means of continuous stationary feedback laws 
In Definition 



defined by 
(11.19) 



11.5 



and in the following, for a G R and j3 G 



(0,13)* 



(<*,py 



ak+l 



By convention, when p = 0, the control system (11.181 is just the control system 
x = f(x,u). The control system ( 11.18 ) is called a dynamic extension of the control 
system x = f(x,u). 



Let us emphasize that for the control system (11.18), the feedback laws u and 
V are functions of x and y. Clearly, if the control system x = f(x,u) is locally 
asymptotically stabilizable by means of continuous stationary feedback laws, it 
is locally asymptotically stabilizable by means of dynamic continuous stationary 
feedback laws. But it is proved in |128j that the converse does not hold. Moreover, 
the example given in [128] shows that the index condition is not necessary for 
local asymptotic stabilizability by means of dynamic continuous stationary feedback 
laws. Clearly the Brockett necessary condition is still necessary for local asymptotic 
stabilizability by means of dynamic continuous stationary feedback laws. But this 
condition turns out to be not sufficient for local asymptotic stabilizability by means 
of dynamic continuous stationary feedback laws even if one assumes that the control 
system (C) is small-time locally controllable at the equilibrium (0, 0) G R n xM m (see 
Definition 3.2 on page 125 I and that the system is analytic. In [102] we proposed 



the following slightly stronger necessary condition. 

Theorem 11.6. Assume that the control system x = f(x,u) can be locally 
asymptotically stabilized by means of dynamic continuous stationary feedback laws. 
Then, for every positive and small enough e, 

(11.20) /* K_i {{{x, u); \x\ + \u\ < e, f{x, u) + 0})) = <7„_i(R n \ {0}) (= Z), 

where cr n _i(A) denotes the stable homotopy group of order (n — 1). (For a definition 
of stable homotopy groups and o//* ; see, e.g., [5011 Chapter XII] .j 

Exercise 11.7. Let n = 2, m = I, O = K 2 x E. We define f by 

f(x, u) := (#2 — 3(:ri — u) 2 xi, (x\ — u) 3 — 3(xi — u)x\Y 



for every x = (xi,^)' 



and every u G 



f(x, u) is small-time locally controllable 
on page 



3.32 



143) 



1. Prove that the control system x 
at (0, 0) G R 2 x R. (Hint. Use Theorem 

2. Check that the control system x = f(x, u) satisfies the Brockett necessary 
condition, i.e., that the image by f of every neighborhood of (0, 0) G R 2 x . 
is a neighborhood of G K 2 . 



3. Prove that (11.20) does not hold 
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Let us point out that the index condition implies (11.201. Moreover, (11.20) 



implies that a "dynamic extension" of x = f(x,u) satisfies the index condition if 
the system is analytic. More precisely, one has the following theorem. 



Theorem 11.8 ( [1081 Section 2 and Appendice]). Assume that f is analytic 
(or continuous and subanalytic) in a neighborhood of (0,0) G K" x W n . Assume 



that (11.20) is satisfied. Then, if p ^ In + 1, the control system (11.18) satisfies 



the index condition. 



For a definition of a subanalytic function, see, e.g., [233j by Heisuke Hironaka. 
Proof of Theorem |11.8[ Clearly, it suffices to prove this theorem for p = 
In + 1. For R > and k G N \ {0}, let 



B k (R) := {z G R fe ; \z\ < R}, B k (R) := {z G R fc ; \z\ < R}. 
Let us assume, for the moment, that the following lemma holds. 

Lemma 11.9. Let E be a subanalytic subset ofR k such that G E and belongs 
to the closure in K fc of E \ {0}. Then there exist e > and an homeomorphism ip 
from -Bfc(e) into itself such that 



(11.21) 

(11.22) 

(11.23) 



\<p(z)\ = \z\,Vz£B k (e), 

ip(z) = z,\fz G dB k (e), 



<p{E n B k (e)) = {tx; te[0,l],xeED B k (e)}. 



For the definition of subanalytic set, see, again, [233 . We apply this lemma 
with k:=n + m and, identifying R n+m to 1" x E m , 

l ;f(x,u) = 0, \ x \ 2 + \u\ 2 ^e 2 }, 

ii c / u oinaii ciiuugn ou uiiciu j id anaiy ui»- un \ i^, xij kz a^ a jt\ , \X\ 

2e 2 }. Let f : B n+m (e) - 



E := {(x,u) GK" x 
with e > small enough so that / is analytic on {(x,u) G K n x 



HI 



€ 



(11.24) 



be defined by 

f:=fo<p- 1 . 



Decreasing if necessary e > and using (11.201 we may also assume that 

"\{0})(=Z), 



(11.25) AK-i({(i,«); M + M <e, /(*,«) ^0})) = o-„_i(E 

Let § 2 ™ = {y G M 2n+1 ; \y\ = 1}. For (ai,a 2 ,a 3 ) G M" 1 x M™ 2 
(ai,a2,a3) tr by 

(«i 
«2 
"3 



prai+n 2 +n3 



From (11.251 and the suspension theorem (see, e.g., [4611 Theorem 11, Chap- 
ter 8, page 458]), there exists a map 9 = (x,u,a) tr G C°(S 2n ;R" +m+n+1 ), with 



(x,u,a)£C°{§ 2 '' 



0fts.2n.mn 



r l+1 ), such that 

tr 



(11.26) 0(S 2n ) C [B n+m (e) x M" +1 J '" \ (f-\0) x {0}) tr , 

(11.27) the degree of g : S 2 ™ -> K 2ti+1 \ {0} is - 1, 
with g defined by 

<?(?/) :=(f(x(y), ^)),a(y)) tr ,V2/GS 2 ". 
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By (11.271 and relying on the degree theory detailed in Appendix [Bl we mean the 
following. We extend 9 = (x,u, a) tT to i?2n+i(l) by letting 



(11.28) 
(11.29) 



(z) = \z\0(z/\z\)i£ \z\?0, 
0(0) = 0. 



Then, we extend g to i?2«+i(l) by letting 

(11.30) g(y) := (f(x(y), u(y)) , a(y)) tT , Vy G B 2n+1 (l). 



Property (11.27) means that 
(11.31) 



degree (g, S 2n +i(l),0) = -1. 



Clearly, 9 G C (.B2n+i(l)i R 2n+1 ) and vanishes at 0. Let r be a small positive real 
number. Let u G C°(R" x E 2n+1 ;R m ) and v g C°{R n x R 2,l+1 ; R 2rl+1 ) be such 
that, for every (x,y) g R" x R 2ti+1 such that |y| < r, 

(11.32) u(x,y) = 7T 2 o ip~ x {x{y),u{y)), 

(11.33) v(x, y) = (a(y),x - m o tp' 1 (x(y) , u(y))) tT , 
where 7Ti and 7T2 are defined by 

TTi («!,%) := 2i g I", 7r 2 (zi,^) := z 2 g R m , V(*i,z 2 ) G R n x R m . 

Clearly, u and u vanish at (0,0) G R n x R 2n+1 . Let F : B 3rl+1 (r) -4R"x R 2n+1 
be defined by 



for every (x, y) G 

if r > is small enough 



F((x,yr):=(f(x,u(x,y)),v(x,y)r, 
x R 2n+1 , such that |ir| 2 + \y\ 2 ^ r 2 . Let us check that, at least 



(11.34) ((x,y) tT G Ba»+i(r) \ {0}, x G R", y G R 2n+1 ) => (F(x,y) ^ 0). 

Let x G R™, y G R 2n+1 be such that (x, y) tr G B 3n+1 (r) and F((x, j/) tr ) = 0. Then 

(11.35) X = irioip~ 1 (x(y),u(y)), 

(11.36) a(|/)=0, 

(11.37) /(x^2o^- 1 (x(2/),w(y))) = 0. 



From (11.351 and (11.371, one gets 

(n.38) /(£(y),«(y)) = o. 



From flll.35| , ( |11.21| , ( |11.28| , (|ll_36j) and flll.38| , one has 
(11.39) y = 0. 



From flll.29| , ( |11.33| , ( |11.35| and (|ll_39j), one gets 

x = 0, 



which, together with (11.39), concludes the proof of (11.341. 

Let us now prove that, at least if r > is small enough (which is always 
assumed), then 

(11.40) degree (F,B 3n+1 (r),0) = (-l) 3n+1 . 
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Let U:B 3n+1 {r) 



U 



3n+1 be defined by 

/ x-m o<p- 1 (3;(y),u(y)) 
= f(x,TT 2 ° if~ 1 (x(y) 7 u(y))) 



l 2n+1 such that Ixl 2 



\y\ 2 <r 2 . 



for every (x, y) G W 

Using Proposition |B . 1 2] on page [388] one gets 

(11.41) degree {F, B 3n+1 {r),0) = (-l) n degree (U, B 3n+1 {r), 0) 

on page 



Using (11.30), (11.411, Proposition B.ll 



page |389| one gets that 

degree (F,B 3n+1 (r),0) 



388 and Proposition B.14 
(-l)Megree(g,B 2n+1 (l),0), 



on 



which, together with (11.31), gives (11.40) 



It remains to prove Lemma |11.9 Let us point out that this lemma is proved 
in [358, Theorem 2.10] by John Milnor if E is a subanalytic set having an isolated 



singularity at (0, 0) (if (0, 0) is not a singularity of E, Lemma 11.9 obviously holds) 



The general case has been treated by Robert Hardt in [21 7( pages 295-296]: with 
the notations of [2"T7] , one takes E for X, R m+n for R m , [0,+oo) for Y, y >-> \y\ 2 
for /. (In fact, [217j deals with semialgebraic sets, instead of subanalytic sets. 
However, the part of [217j we use holds for subanalytic sets.) This concludes the 
proof of Theorem |11.8| ■ 



Let us end this section by an open problem: 



Open Problem 11.10. Let us assume that f is analytic, satisfies (11.20) and 
that the control system x = f(x,u) is small-time locally controllable at the equilib- 
rium (0, 0) G R™ x W n (or even that G R™ is locally continuously reachable in 
small time for the control system x = f(x,u); see Definition 11.20 below). Is the 
control system x = f(x,u) locally asymptotically stabilizable by means of dynamic 
continuous stationary feedback laws? 

A natural guess is that, unfortunately, a positive answer is unlikely to be true. 
A possible candidate for a negative answer is the control system, with n = 3 and 
m = 1, 

xi = X$(xi - x 2 ), x 2 = xj(x 2 - x 3 ), x 3 = u. 
This system satisfies the Hermes condition S(0) and so, by Sussmann's Theo- 
rem 3.29 on page 143 is small-time locally controllable at the equilibrium (0,0) G 

(xi 



Moreover, it satisfies the index condition (take u = x 3 
11.2. Time-varying feedback laws 



A))- 



In this section we will see that, in many cases, small-time local controllability 
at the equilibrium (0, 0) G W 1 x W 71 implies local asymptotic stabilizability by 
means of continuous time- varying feedback laws. We first treat the case of driftless 



11.2.21 



control systems (Section 11.2.1 1. Then we consider general control systems (Section 



Let us start with some classical definitions. Let us first recall the definition of 
asymptotic stability for a time-varying dynamical system — we should in fact say 
uniform asymptotic stability. 
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Definition 11.11. Let £1 be an open subset of E™ containing 0. Let X in 
C a {n xE;E") be such that 

X(0,t) = 0, VieE. 
One says that is locally asymptotically stable for x = X(x, t) if 

(i) for every e > 0, there exists rj > such that, for every s£K and for every 

T ^ S, 

(11.42) (i = X(x,t), \x(s)\ < rj) =* (|s(r)| < e), 

(ii) there exists 5 > such that, for every e > 0, there exists M > such that, 
for every s in E, 

(11.43) x = X(x,t) and |a;(s)| < 6 
imply 

(11.44) |jc(t)| <e, Vr >s + M. 

If f2 = E" and if, for every 5 > and for every e > 0, there exists M > such that 



(11.431 implies (11.441 for every s in E, one says that is globally asymptotically 



stable for x = X(x,t). 



Throughout the whole chapter, and in particular in (11.42) and (11.431, every 
solution of x = X(x,t) is assumed to be a maximal solution of this differential 
equation. Let us emphasize again the fact that, since the vector field X is only 
continuous, the Cauchy problem x = X(x,t),x(t ) = x , where to and Xq are 
given, may have many maximal solutions. 

Let us recall that Jaroslav Kurzweil in 289] has shown that, even for time- 
varying vector fields which are only continuous, asymptotic stability is equivalent 
to the existence of a Lyapunov function of class C°°; see also |99j . This Lyapunov 
function provides some important robustness properties with respect to (small) 
perturbations. 

Remark 11.12. One can easily check that, if X does not depend on time or is 



periodic with respect to time, then (ii) implies (i) in Definition 11.11 But this is 
not the case for general time- varying X. 

Let us now define "asymptotic stabilizability by means of continuous time- 
varying feedback laws" . 

DEFINITION 11.13. The control system (C) is locally (resp. globally) asymptot- 
ically stabilizable by means of continuous time-varying feedback laws if there exists 
u e C°(E™ x E; E m ) satisfying 

u(0,t) = 0, VieE, 

such that G E n is locally (resp. globally) asymptotically stable for the closed-loop 
system x = f(x, u(x, t)). 

11.2.1. Stabilization of driftless control afRne systems. In this section, 
we assume that 

m 

f{x,u) = 22,Uifi{x). 
We are going to see that the driftless control systems which satisfy the Lie algebra 



rank condition (see Definition 3.16 on page 134 I at every (x,0) G E n x E m with 
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x G W l \ {0} can be globally asymptotically stabilized by means of continuous 
time- varying feedback laws. 

Let us recall that Lie{/i, . . . , f m } C C°°(K"; 
of C°°(R";R ra ) generated by the vector fields /i 
page 



n ) denotes the Lie sub- algebra 

on 



, f m (see Definition 3.13 



133 1. One then has the following theorem. 



Theorem 11.14 ( [103] ). Assume that 

(11.45) {g(x); g G Lie{f u . . . , f m }} = R n , 
Then, for every T > 0, there exists u in C°°{W a x 

(11.46) u(0, t) = 0, V* G M, 

(11.47) u(x,t + T) = u(x,t),Vx eW 
and is globally asymptotically stable for 



VxG 



r \ {o}. 



Vie 



(11.48) 



x = f{x,u(x,t)) 



i=l 



Ui(x,t)fi(x). 



Remark 11.15. By the Rashevski-Chow theorem [398| [94] (Theorem 3.18 



134 I, Property (11.45 I implies the global controllability of the driftless control 
E™ i Uifi(x) in K" \ {0}, i.e., for every x° G K" \ {0}, 

((0,T);K m ) such that, if 
\ {0} for every 



page 

affine system x = f(x,u) 

every x 1 G K™ \ {0} and every T > 0, there exists u £ L 
x = Ei=i u i(t)fi( x ) an d x(0) = a; , then a;(T) = x 1 (and cc(t) G 

on page 



134 for every a G 



t G [0, T]). Let us recall that, by Theorem 3.17 

{g(a);geUe{f 1 ,...J m }} = R n , 

is also a necessary condition for small-time local controllability at the equilibrium 
(a, 0) G R n x K m of the driftless control affine system x = f(x, u) = YliLi u ifi( x ) 
if the fi, 1 ^ i ^ m, are analytic. 

Example 11.16. Let us return to the nonholonomic integrator 

(11.49) 



X\ = Ul, X 2 = U 2 , X 3 = X\U 2 - X 2 U\. 



It is a driftless control affine system where the state is (x-\ 
control is (ui,u 2 ) tr G K 2 



,x 2 ,x 3 ) tr G 



and the 



fi(x) : 




2 and 



, h{x) :- 



As we have seen in Example 3.20 on page 135, it follows from Theorem 3.19 



page \135\ that this control system is small-time locally controllable at the equilibrium 



6.3 



(x e ,u e ) = (0,0) £ l 3 x I 2 and also globally controllable. (See also Example 
page \190\ for a proof based on the return method. A simple scaling argument shows 
that the small-time local controllability proved in this example, implies global control- 
lability.) However, as we have seen in Example 11.2 on page 289 , the nonholonomic 
integrator does not satisfy Brockett's condition and therefore, by Theorem \l 1 . 1\ it 
cannot be, even locally, asymptotically stabilized by means of continuous stationary 
feedback laws. But, as we have seen in Example \3.20\ on page \135\ the nonholo- 
nomic integrator satisfies the Lie algebra rank condition at every {x, 0) 6 I 3 x M 2 , 



{g(x); g G Lie{fi,f 2 }} 



VxG 
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Hence, by Theorem \11.14\ the nonholonomic integrator can be, even globally, asymp- 
totically stabilized by means of periodic time- varying feedback laws of class C°° . 

Sketch of the proof of Theorem |11.14[ Let us just briefly describe the 
idea of the proof: Assume that, for every positive real number T, there exists u in 
C°°{R n x R; R m ) satisfying ( flL46| and ( fil~47) , and such that, if x = f(x, u{x, t)), 
then 

(11.50) x(T) = x(0), 

(11.51) if a;(0) ^ 0, then the linearized control system around the trajectory 

t e [0,T] i-> (x(t),u(x(t),t)) is controllable on [0,T]. 



Using (11.50 I and ( 11.51 ), one easily sees that one can construct a "small" feedback 
v in C°° 



D (K™ x K;R m ) satisfying ( |ll.46| and ( |ll.47| , and such that, if 

(11.52) x = f(x,(u + v)(x,t)) 
and x(0) ^ 0, then 

(11.53) \x(T)\ < 11(0)1, 



which implies that is globally asymptotically stable for ( 1 1 .48 ) with u 



So it only remains to construct u. In order to get (11.50), one just imposes on 
u the condition 

(11.54) u{x, t) = -u(x, T-t), V(a;, t) G K" x K, 

which implies that x(t) = x(T — t),\/t£ [0, T] for every solution of x = f(x, u(x, t)) 



(proceed as in the proof of (6.9) above), and therefore gives (11.501. Finally, one 
proves that (11.511 holds for "many" m's. ■ 



Remark 11.17. The above method, that we called "return method" (see Chap- 
ter p| , can also be used to get controllability results for control systems even in 
infinite dimension, as we have seen in Section |6.2| Section [6. 3 1 and in Chapter [9] 

Remark 11.18. The fact that (11.511 holds for "many" u's is related to the 
prior works [452] by Eduardo Sontag and [206 by Mikhael Gromov. In [452 
Eduardo Sontag showed that, if a system is completely controllable, then any two 
points can be joined by means of a control law such that the linearized control 
system around the associated trajectory is controllable. In |206l Theorem page 
156] Mikhael Gromov has shown that generic under-determined linear (partial) 
differential equations are algebraically solvable, which is related to controllability 
for time- varying linear control systems (see the second proof of Theorem 1.18 on 



page 



11 ). In our situation the linear differential equations are not generic; only the 
controls are generic, but this is sufficient to get the result. Moreover, as pointed 
out by Eduardo Sontag in 456J, for analytic systems, one can get (11.51 1 by using 



a result due to Hector Sussmann on observability |466j . Note that the proof we 
give for (11.51) in [103 (see also |105| ) can be used to get a C°°-version of [466 ; 
see [T06] . 



Remark 11.19. Using a method due to Jean-Baptiste Pomet [387], we gave 
in [127] a method to deduce a suitable v from u; see Section 12.2.2 below for a 
description of this method. 
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11.2.2. Stabilization of general systems. 

(C) the nonlinear control system 



(C) 



x = f(x,u), 



In this section we still denote by 



where x G R™ is the state, u G R m is the control. We again assume that 



(11.55) 



/(0,0)=0 



and that, unless otherwise specified, / G C°°{0\W l ), where O is a an open subset 
of R" x R m containing (0,0). 

Let us first point out that in i460j Eduardo Sontag and Hector Sussmann 
proved that every one-dimensional state (i.e., n = 1) nonlinear control system which 
is locally (resp. globally) controllable can be locally (resp. globally) asymptotically 
stabilized by means of continuous time-varying feedback laws. 

Let us also point out that it follows from |467] by Hector Sussmann that a 



result similar to Theorem 11.14 does not hold for systems with a drift term; more 



precisely, there are analytic control systems (C) which are globally controllable, 
for which there is no u in C°(W l x R;R m ) such that is globally asymptotically 
stable for x = f(x,u(x,t)). In fact, the proof of [467 requires uniqueness of the 
trajectories of x = f(x,u(x,t)). But this can always be assumed; indeed, it follows 
easily from KurzweiPs result |289j that, if there exists u in C°(R™ x R;R m ) such 
that is globally asymptotically stable for x = f(x,u{x,t)), then there exists u in 
C°(R n x R; R m ) n C°° ((R" \ {0}) x R; R m ) such that is globally asymptotically 
stable for x = f(x,u(x,t)); for such a u one has uniqueness of the trajectories of 
x = f(x,u(x,t)). 

However, we are going to see in this section that a local version of Theorem 



11.14 holds for many control systems which are small-time locally controllable. 

For e G (0,+oo), let 



(11.56) 



B e := {a e R n ; |»| < e}, B e := {a e R"; \a\ ^ e}. 



Let us again introduce some definitions. 

Definition 11.20. The origin (of R") is locally continuously reachable in small 
time (for the control system (C)) if, for every positive real number T, there exist a 
positive real number e and an element u in C° (B e ; L 1 ((0, T); R m )) such that 



(11.57) 
(11.58) 



((i 



Sup{|u(a)(i)|;ie (0,T)} ^Oasa^O, 
f(x,u(a)(t)), x(0) = a) =► (x(T) = 0)),Va e B e 



Let us prove that 



bility (see Definition 3.2 



many 
on page 



sufficient conditions for small-time local controlla- 
< R m imply that the origin is 



125) at (0,0) G 



locally continuously reachable in small time. This is in particular the case for the 

and 



Sussmann condition (Theorems 3.29 



143 



3.32 



on page 



143 1; this is in 



on page 

fact also the case for the Bianchini and Stefani condition [56, Corollary page 970], 
which extends Theorem |3.29| on page |143| 

In order to prove this result, we first introduce the following definition. 
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Definition 11.21. For p G N \ {0}, let D p be the set of vectors £ in 1" such 
that there exists u in C°([0, 1]; £ x ((0, 1); R m )) such that 

(11.59) |«(«)(t)|<«,V(*,t)e [0,1] x [0,1], 

(11.60) u(a)(*) =0, if i ^ s, 

(11.61) V>("(s)) = s p £ + o{s p ), as s -> 0, 

where ^(u(s)j denotes the value at time of the solution of x = f(x,u(s)(tj), 
x(l) = 0. Let Dcfbe defined by 

(11.62) D := (J L> p . 

p^i 
Then one has the following proposition. 

PROPOSITION 11.22 ( |105| Lemma 3.1 and Section 5]). Assume that 

(11.63) is in the interior of D. 

Then G R n is locally continuously reachable in small time (for the control system 



Proof of Proposition |11.22[ We follow a method due to Matthias Kawski 
[270] (see also |227j by Henry Hermes). In [2701 Appendix], Matthias Kawski 



proved (under the assumption of Proposition 11.22) the existence of u : B e 
L 1 ((0,T);R m ) satisfying (|ll.57| and (T~ 



11.58). His u is not continuous. However, 



let us show how to slightly modify his proof in order to have a continuous u. Let 
(ei)i<»<« be the usual canonical basis of R™ and let ej = —ei- n for i in {n + 



1, . . . , 2n}. By ( |ll.63| and noticing that, for every !eN\ {0}, D l C D l+l , we may 
assume, possibly after a change of scale on x, that, for some p ^ 1, e* G -D p for 
every i in {1, 2, . . . , 2n{. For i in {1, 2, . . . , 2n{, let Ui be as in Definition 111. 21 



, , 2n}. For i in {1,2, ... , 2n}, let u, be as in Definition 
£ = Cj. For a in K" we write a = 2*=i a » e i with Oj ^ for every i in {1,2 
and aiOi +n = for every i in {1, . . . , n}. Let fj,(a) = X)j=i a i e i- For a in 
|a| < 1, let u a : [0, p{a)) -> R m be defined by 

j — 1 j 

«„(*) = u^X* - *,) if t, := ^ a] /p ^t<J2 *¥■ 

i=l i=\ 



with 
..,2n} 

r with 



(11.64) 



From Gronwall's lemma, ( |11.59| , ( |11.60| , ( |11.61[ ) and ( |11.64| , we get 

(11.65) M^a) = °(l I ( a )) as a — > 0, 

where £* := C a (/i(a)), Ca : [0iM a )] being the solution of the Cauchy problem 

(11-66) (a = f((a,U a (t)),( a (0) = a. 

Hence, for \a\ small enough, 

(11.67) p(*i) < ^. 

We now define u a on [/*(a), ;u(o) + £t(Xa)) by 

u a (t) :=u x i(t- ju(o)), Vt G [/i(a),/i(a) + /i(a;o)) . 
We have, if \a\ is small enough, that 
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where x„ := C, a {p,(a) + /•*(£„)), Ca still being the solution of the Cauchy problem 
(11.661, but now on \0, p(a) + p(xl)] (instead of [0,p(a)}). We keep going and 
define in this way u a on [0,/i(a) + J^Li MOO) (with obvious notations). Note 
that, if a is small enough, /x(a) + $^ =1 M 2 ^) ^ 2/i(a) < T. We extend u a on [0, T] 
by u a (i) = if t G [M a ) + Ei=i MC^i)) ^T Then w(a) := u a satisfies all the required 
properties required in Definition |11.20| on page |299| This concludes the proof of 
Proposition |11.22| ■ 



Our next proposition is the following. 

Proposition 11.23. Assume that the control system (C) satisfies the Suss- 
on page 



vnann condition S(8) (see Definition 3.31 
\11.63\) holds. 



143) for some 6 G [0, 1]. Then 



The proof of Proposition 11.23 follows directly from the proof of [469, Theorem 
7.3] by Hector Sussmann (see also the proof of Theorem 3.32 on page 143 I. We 
omit it. 



The following theorem is a consequence of Proposition |11.22| and Proposition 
ITl~23l 



Theorem 11.24. Assume that the control system (C) (see page 299) satisfies 
the Sussmann condition S(6) (see Definition 3.31 on page 143) for some 9 G [0, 1]. 
Then G W 1 is locally continuously reachable in small time (for the control system 
(C)). 

In fact, the sufficient conditions for small-time local controllability we men- 
tioned earlier on page 143 (namely ,5 j by Andrei Agrachev, (6J [7] by Andrei 
Agrachev and Revaz Gamkrelidze, |55j by Rosa Maria Bianchini, and |56j by Rosa 



Maria Bianchini and Gianna Stefani) all implied (11.63). In particular, the hypoth- 
esis of [56, Corollary p. 970], which is weaker than the hypothesis of Proposition 



11.23 also implies (11.631. It sounds natural to conjecture a positive answer to the 



question raised in the following open problem. 

Open Problem 11.25. Assume that the map f is analytic in an open neigh- 
borhood of (0, 0) G R n x K m and that the control system (C) is small-time locally 
controllable at the equilibrium (0,0) G K™ x K m . Is G 1" locally continuously 
reachable in small time (for the control system (C))? 

Concerning the converse, one has the following theorem. 

Theorem 11.26. Let us assume that is locally continuously reachable in 
small-time for the control system (C) . Then the control system (C) is small-time 
locally controllable at (0,0) G K" x K m . 

Proof of Theorem |11.26[ We assume that is locally continuously reachable 
in small time (for the control system (C)). Let e > 0. Then there exist a real 
number p > and a map u in C° {B p ; L l ((0,£);K m )) such that 

(11.68) |«(o)(t)| < e, Va G B p , Vt G [0,e], 

(11.69) (x = f(x,u(a)(t)), \a\ ^ p, x(0) = a) =3- (x(e) = 0). 
Let p, > 0. Let <£■ be the map 



B p xB p 

{a,x v ) 



x(0), 
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where x : [0,e] — > SJ 1 is the solution of the Cauchy problem 

x = f(x,u(a)(t)), x(e) =x 1 . 



By (11.691, there exists /i > such that $ is well defined. We fix such a /i. Then 

a, Vb e B . 



$ is continuous and, still by (11.691 
(11.70) 



*(o,0) 

Hence, degree(<J>,i?p,0) is well defined and 

(11.71) degree($(-,0),B p ,0) = l. 

For the definition of the degree, see Appendix |B| By the continuity of the degree 
(Property (iii) of Theorem B.l on page 379 and Proposition B.9 i 
exists r\ G (0, //) such that, for every x u G B v and for every x L € B v , 

(11.72) degree ($(-,x 1 ),S p , x°) = 1. 



on page 



3871, there 



By a classical property of the degree theory (Proposition B.10 
implies the existence of a € B p such that 

(11.73) <£{a,x 1 )=x°. 



on page 



3871, (11.72) 



But (11.731 just means that 

(x = f(x,u(a)(t)),x(0) = 
This concludes the proof of Theorem |11.26| 



>)^(x(e) = x 1 ). 



Our next definition follows. 

Definition 11.27. The control system (C) is locally stabilizable in small time 
by means of continuous periodic time-varying feedback laws if, for every positive 



real number T, there exist e in (0, +00) and u in C (I 



such that 



u(0,t) = 0, WgR, 

u(x,t + T) =u(x,t), WgR, 

{{x = f(x, u(x, t)) and x(s) = 0) => (z(r) = 0, Vt > s)) , Vs e R, 

(A = f(x,u(x,t)) and |x(s)| < e) => (aj(r) = 0, Vr ^ s + T)), Vs G R. 

If u can be chosen to be of class C°° on (R™ \ {0}) x R, one says that the control 
system (C) is locally stabilizable in small time by means of almost smooth periodic 
time-varying feedback laws 



(11.74) 
(11.75) 
(11.76) 
(11.77) 



Note that (11.751, (11.761, and (11.77) imply that G R" is locally asymp- 



totically stable for x = f(x.u(x.t)): see |109( Lemma 2.15] for a proof. Note 
that, if (C) is locally stabilizable in small time by means of almost smooth periodic 
time- varying feedback laws, then G R" is locally continuously reachable for (C). 
The main result of this section is that the converse holds if n ^ {2,3} and if (C) 
satisfies the Lie algebra rank condition at (0, 0) G R" x K m : 



Theorem 11.28 ( [109] for n ^ 4 and [TTP] for n = 1). Assume that G R" 
is locally continuously reachable in small time for the control system (C), that (C) 
satisfies the Lie algebra rank condition at (0,0) G R™ x K m (see Definition 3. It 
page 134) an -d that 
(11.78) n^{2,3}. 



11.2. TIME-VARYING FEEDBACK LAWS 



:;m 



Then (C) is locally stabilizable in small time 
time-varying feedback laws. 



means of almost smooth periodic 
We conjecture a positive answer to the following open problem. 



Open Problem 11.29. Can Assumption (11.78) be removed in Theorem 11.28 



Sketch of the proof of Theorem 11.28 for n > 4. Let I be an interval 
of R. By a smooth trajectory of the control system (C) on 7, we mean a (7, u) G 
C°° (I;K n x R m ) satisfying <y(t) = f(j(t),u(t)) for every t in I. The linearized 

on page 



control system around (7, u) is (see Definition 3.5 



1271 



where the state is £ G 
df 



£ = A(t)Z + B(t)w, 

the control is w G R m , and 

0/, 



A(t) = ^(7(*),«(t)) € £(R";R") , B(i) = ^(7(*),«(*)) G£(R ra ;R n ) ,Vt€l. 
We first introduce the following definition. 

Definition 11.30. The trajectory (7, u) is supple on S <Z I if, for every s in 



5, 
(11.79) 



Span ■ 



A(t) B(t)\ t=s w ; weR m ,i^ 



In (11.79), we use the classical convention 



d 

d7 



A(t)\ B{t) = B{t). 



Let us recall that, by Theorem 1.18 



11 



(11.791 implies that the linearized 



on page 

control system around (7, u) is controllable on every interval [To, T{\, with To < Ti, 
which meets S. Let T be a positive real number. For u in C° (R™ x [0, T]; R m ) and 
a in R", let 1 1— > x(a,t; u) be the maximal solution of 

Ox 

Also, let C* be the set of u G C° (R™ x [0, T]; R m ) of class C°° on (R n \ {0}) x [0, T] 
and vanishing on {0} x [0,T]. For simplicity, in this sketch of proof, we omit some 
details which are important to take care of the uniqueness property (11.76) (note 



f(x,u(a,t)), x(a,Q;u) = a. 



that without (11.761 one does not have stability). 



Step 1. Using the fact that G R™ is locally continuously reachable in small time 
for the control system (C), that (C) satisfies the Lie algebra rank condition at 
(0, 0) G R" x R m and [IPS] or [106] . one proves that there exist e a in (0, +00) and 
U\ in C* , vanishing on R" x {T}, such that 

\a\ ^ ei =>• x(a,T;ui) = 0, 
< \a\ < £1 => (x(a, ■; ui),Ui(a, ■)) is supple on [0,T]. 

Step 2. Let T be a 1-dimensional closed submanifold of R n \ {0} such that 

Tc {i£l";0< \x\ < £l }. 
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Perturbing in a suitable way u\, one obtains a map 112 € C*, vanishing on R" x {T}, 
such that 

\a\ < £1 =>• x(a,T;u 2 ) = 0, 

< |a| ^ £1 =>• (cc(a, ■; u%), 112(0*, ■)) i s supple on [0, T], 

ogTh x (t, a; u 2 ) is an embedding of T into R™ \ {0}, Vt € [0, T). 

Here one uses the assumption n ^ 4 and one proceeds as in the classical proof of 
the Whitney embedding theorem (see e.g. |202| Chapter II, Section 5]). Let us 
emphasize that it is only in this step that this assumption is used. 

Step 3. From Step 2, one deduces the existence of u*. in C* , vanishing on R™ x {T}, 
and of an open neighborhood Af* of Y in W 1 \ {0} such that 

(11.80) a&Af* ^> x{a,T;u* 3 ) = 0, 

a G Af* i-* x{a,t]U%) is an embedding of Af* into R n \ {0}, Vt G [0,T). 

This embedding property allows us to transform the open-loop control u*. into 
a feedback law U3 on {(x (a, t; u*f) ,t) ; a € TV*, £ € [0,T)}. So (see in particular 



(11.80 1 and note that u 3 vanishes on R" x {T}) there exist u 3 in C* and an open 
neighborhood Af of V in K n \ {0} such that 

(x(0) G Af and cc = f (x,u 3 (x,t))) => (x(T) = 0). 

One can also impose that, for every r in [0,T], 

(i = / (x, u 3 (x, t)) and x(t) = 0) => (a;(t) = 0, V£ e [t, T]). 

Step 4. In this last step, one shows the existence of a closed submanifold T of 
1" \ {0} of dimension 1, contained in the set {x G K n ; < \x\ < £1}, such that, for 
every neighborhood Af of V in K™ \ {0}, there exists a time-varying feedback law 
U4 in C* such that, for some £4 in (0, +00), 

(x = /(x,u 4 (a;,£)) and |cc(0)| < £ 4 ) ^> (x(T) G A/"u{0}), 

((i = / (x, u 4 {x, t)) and x(r) = 0) =>• (x(*) = 0, Vi G [t, T])) , Vt G [0, T]. 

Finally, let tt:l"xl-> W n be equal to u 4 on K n x [0,T], 2T-periodic with 
respect to time, and such that u(x, t) = u 3 {x, t — T) for every (x, t) in W l x (T, 2T). 
Then u vanishes on {0} x M., is continuous on K" x (K\ZT), of class C°° on 
(K n \ {0}) x (R \ ZT), and satisfies 

(i = / (x, u(x, t)) and |x(0)| < £4) => (x(2T) = 0) , 

(x = f(x,u(x,t)) and i(t) = 0) ^> (x(t) = 0, V£ > t),Vt G K, 



which implies (see |109j ) that (11.77) holds, with 4T instead of T and £ > 



small enough, and that G R™ is locally asymptotically stable for the system 



x = f (x, u(x, t)) . Since T is arbitrary, Theorem 11.28 is proved (modulo a problem 



of regularity of u at (x, t) in R™ x ZT, which is fixed in |109| ). 



Example 11.31. Let us again go back to control system (3.12) of the attitude 



of a rigid spacecraft, already considered in Example \3.9\ on page 12i% Example \3.35\ 



on 



page \144\ Example \10. 15\ on page \282\ and Example \ll-3\ on page \28£\ We 



assume that m = 2, and that (3.81) holds, which is generically satisfied. Let us 
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:;of, 



recall (see Example 3.35 on page 144 ^ that, under this assumption, El-Yazid Kerai 
checked in [272 that the control system (3.12) satisfies Sussmann's condition S(l) 
which, by Theorem 11.24 on V a 9 & 301, implies that G K 6 is locally continuously 
reachable for the control system (3.12). Hence, by Theorem 11.28 on page 302\ 
for every T > 0, there exists a T -periodic continuous time-varying feedback law 



which locally asymptotically stabilizes the control system (3.12). For the special 



case where the torque actions are exerted on the principal axis of the inertia matrix 
of the spacecraft, the construction of such feedback laws was done independently 
by Pascal Morin, Claude Samson, Jean-Baptiste Pomet and Zhong-Ping Jiang in 
|367j . and by Gregory Walsh, Richard Montgomery and Shankar Sastry in [497 . 
The general case has been treated in |126j : see Example 12.18 on page 330 Simpler 



feedback laws have been proposed by Pascal Morin and Claude Samson in [364] . In 



Sections 12.4 an d i-2.5 we explain how the feedback laws of [364] are constructed. 



Many authors have constructed explicit time- varying stabilizing feedback laws 
for other control systems. Let us mention, in particular: 

- Loth Beji, Azgal Abichou and Yasmina Bestaoui for their paper [46 dealing 
with the stabilization of an under-actuated autonomous airship. 

- Zhong-Ping Jiang and Henk Nijmeijer for their paper [256] dealing with 
the tracking of nonholonomic systems in chained form. 

- Naomi Leonard and P.S. Krishnaprasad for their paper [312j explaining 
how to construct explicit time- varying stabilizing feedback laws for driftless, 
left-invariant systems on Lie groups, with an illustration for autonomous 
underwater vehicles (see also [311 J. 

- Sonia Martinez, Jorge Cortes and Francesco Bullo for their paper [345 
where they show how to use averaging techniques in order to construct sta- 



bilizing time- varying feedback (see also Section 12.4 I, with an application 



to a planar vertical takeoff and landing aircraft (PVTOL). 

- Frederic Mazenc, Kristin Pettersen and Henk Nijmeijer for their paper 
[348] dealing with an underactuated surface vessel. 

- Robert M'Closkey and Richard Murray for their paper 351J dealing with 
the exponential stabilization of driftless systems using time- varying homo- 
geneous feedback laws. 

- Pascal Morin, Jean-Baptiste Pomet and Claude Samson for their paper 
[363] , in which they use oscillatory control inputs which approximate mo- 
tion in the direction of iterated Lie brackets in order to stabilize driftless 
systems. 

- Abdelhamid Tayebi and Ahmed Rachid for their paper [474; dealing with 
the parking problem of a wheeled mobile robot. 

- Bernard Thuilot, Brigitte d'Andrea-Novel, and Alain Micaelli for their pa- 
per [480] dealing with mobile robots equipped with several steering wheels. 

11.3. Output feedback stabilization 

In this section, only part of the state (called the output) is measured. Let us 
denote by (C) the control system 

(11.81) (C): x = f{x,u),y = h{x), 

where x G W 1 is the state, u G K m is the control, and y G W is the output. Again, 

/ G C°°(R™ x K m ;I 



and satisfies (11.31. We also assume that h G C° 
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and satisfies 

(11.82) h(0) = 0. 

In order to state the main result of this section, we first introduce some defini- 
tions. 

Definition 11.32. The control system (C) is said to be locally stabilizable in 
small time by means of continuous periodic time-varying output feedback laws if, 
for every positive real number T, there exist e in (0, +00) and u in C°(R" x R; R m ) 



such that ( |11.74[ ), ( |ll.75[ ), ( |ll.76| , ( |ll.77| hold and such that 

(11.83) u(x,t) = u(h(x),t) 
for some u in C°(R P x R; R"). 

Our next definition concerns dynamic stabilizability. 

Definition 11.33. The control system (C) is locally stabilizable in small time 
by means of dynamic continuous periodic time-varying state (resp. output) feedback 
laws if, for some integer k ^ 0, the control system 

(11.84) x = f(x, u), z = v, h(x, z) = (h(x), z), 

where the state is (x,z) G R n x R fe , the control (u,v) G R m x R fc , and the output 
h(x,z) G R p x R fe , is locally stabilizable in small time by means of continuous 
periodic time-varying state (resp. output) feedback laws. 



In the above definition, the control system ( 11.84 ) with k = is, by convention 



the control system (C). Note that "locally stabilizable in small time by means of 
continuous periodic time-varying state feedback laws" is simply what we called 
"locally stabilizable in small time by means of continuous periodic time-varying 
feedback laws" in Definition |1 1 ,27| on page |302j 

For our last definition, one needs to introduce some notations. For a in N m 
and u in R m , let fg in C°°(R n ; 1") be defined by 

gHf 



(11.85) 



f£(x) 



du a 



■(x,u), Vie G 



Let 0(C) be the vector subspace of C°°(M n x M m ; W) spanned by the maps u) such 
that, for some integer r ^ (depending on to) and for some sequence ot.\, ..., a r of r 
multi- indices in N m (also depending on to), we have, for every x G IR™ and for every 

ueR m , 

(11.86) u>(x,u) =L f «i...L fS rh(x). 

and in the following, for X = (X x , . . . , X n ) tr : R" -> R" 
' — y R denotes the (Lie) derivative of V in the direction 



Let us recall that in (11. 
and V : R n -> R, L X V 



of X as defined by (3.91 1. By convention, if r = 0, the right hand side of ( 11.86 ) is 



h(x). With this notation, our last definition is the following. 

Definition 11.34. The control system (C) is locally Lie null-observable at the 
equilibrium (0, 0) G R" x R m if there exists a positive real number e such that the 
following two properties hold. 

(i) For every a in R" \ {0} such that \a\ < e, there exists q G N such that 

(11.87) L%h(a)^0, 
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with fo(x) = f(x,0) and the usual convention L°r h = h. 

(ii) For every (01,02) G (R™ \ {0}) 2 with ai / 02, |ai| < s, and |a,2 1 < £, and for 
every u in K m with \u\ < e, there exists u> in 0(C) such that 

(11.88) uj(ai,u) ^ u(a2,u). 



In ( |11.87[ ) and in the following, for k G N, X = (X u . . . , X n ) tT : R" -> R™ and 
V : R n -> W, L k x V : R" -» W denotes the iterated (Lie) derivative of V in the 
direction of X. It is defined by induction on k by 

(11.89) L X V := V, L k x +1 V := L x {L k x V). 
Remark 11.35. Note that (i) implies the following property: 

(i)* for every a 7^ in B E := {x G R m , |a;| < e}, there exists a positive real number 
r such that 

x(t) exists and h(x(r)) 7^ 0, 

where x is the (maximal) solution of X = f(x,0),x(0) = a. Moreover, if / and 
g are analytic, (i)* implies (i). The reason for "null" in "null-observable" comes 
from condition (i) or (i)*; roughly speaking we want to be able to distinguish from 
every a in B E \ {0} by using the control law which vanishes identically — u = 0. 

Remark 11.36. When / is affine with respect to u, i.e., f(x,u) = fo(x) + 
Y^iLi u ifi{ x ) w ith /lj ■■•, fm in C°°(R™;R n ), then a slightly simpler version of (ii) 
can be given. Let 0(C) be the observation space (see e.g. |222 or [458> Remark 
6.4.2]), i.e., the set of maps u> in C°°(R n ;R p ) such that, for some integer r ^ 
(depending on Co) and for some sequence i\, ...,i r of integers in [0,m], 

(11.90) u(x) = L fii ...L fir h{x), Vx G R", 

with the convention that, if r = 0, the right hand side of (11.90) is h(x). Then (ii) 
is equivalent to 

(11.91) ((01, 02) G S 2 , w(oi) = u>(a 2 ), Vw G 0(C)) ^ (ai = o 2 ). 

Finally, let us remark that if / is a polynomial with respect to u or if / and g 
are analytic, then (ii) is equivalent to 

(ii)* for every (01,02) G R" \ {0} with ai 7^ 02, |ai| < e and |a.2 1 < e, there exists u 
in R m and ui in O(C) such that (11.88 1 holds. Indeed, in these cases, the subspace 
of R p spanned by {to(x, u); u> G O(C)} does not depend on u; it is the observation 
space of (C) evaluated at x, as defined for example in [222 . 

With these definitions we have the following theorem, proved in [107j . 

Theorem 11.37. Assume that the origi n (o/R ") is locally continuously reach- 
able (for (C)) in small time (see Definition 11.201. Assume that (C) is locally Lie 
null-observable at the equilibrium (0,0) G R" X R m . Then (C) is locally stabiliz- 
able in small time by means of dynamic continuous periodic time-varying output 
feedback laws. 

Sketch of the proof of Theorem |11.37[ We assume that the assumptions 
of Theorem 11.37| are satisfied. Let T be a positive real number. The proof of 
Theorem |11 .37 is divided into four steps. 
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Step 1. Using the assumption that the system (C) is locally Lie null-observable 
at the equilibrium (0,0) G R n x R m and |106j . one proves that there exist u* in 
C°°(R P x [0,T];R m ) and a positive real number e* such that 

u*(y,T) = u*(y,0) = 0, Vy G R p , 

(11.92) u*(0,t) = 0, Vie [0,T], 
and, for every (01,02) in B^, , for every s in (0,T), 

(11.93) (/»&>(«) = fcW(s), V* G N) =► (01 = o a ), 

where /i. a (s) = h{x*{a,s)) with a;* : i? e . x [0,T] — > K", (a,t) i-> x*(a,t), defined by 

Br* 

— = f(x*,u*(h(x*),t)),x*(a,0)=a. 

Let us note that in [350] a similar u* was introduced by Frederic Mazenc and 
Laurent Praly, but it was taken depending only on time and so (11.921, which is 
important to get stability, was not satisfied in general. In this step we do not use 
the local continuous reachability in small time. 

Step 2. Let q = In + 1. In this step, using ( 11.93 1, one proves the existence of 
(q + 1) real numbers < t a < t 1 ... < t q < T such that the map K : B e . — > (R p ) q 
defined by 

(11.94) K(a) :=([ (s - t ){h - s)h a {s)ds 7 ..., /"*(*- to){t q - s)h a (s)ds) 

is one-to-one. Thus, there exists a map 9 : (R p ) 9 — > R n such that 

(11.95) 0oK(a) = x*{a,T), Va e B e . /2 . 

Step 3. In this step, one proves the existence of u in C °(K™ x [0, T]; K m ) and 
e in (0, +00) such that 

(11.96) u = on (R™ x {0,T})U({0} x [0,T]), 

(11.97) (x = f(x,u(x(0),t)) and |x(0)| < e) => (x(T) = 0). 



Property ( 11.971 means that u is a "dead-beat" open-loop control. In this last step, 
we use the small-time local reachability assumption on (C), but do not use the Lie 
null-observability assumption. 

Step 4. Using the above three steps, let us conclude the proof of Theorem 



11.37 The dynamic extension of system (C) that we consider is 

(11.98) x = f{x,u), z = v = {v 1 ,...,v q ,v q+1 ) eFx ... xR p xR n ~R pq+n , 

with zi = (z u ...,z q ,z q+ i) £ W x ... xWx R n ~ W q+n . For this system the 
output is h(x,z) = (h(x),z) e W x «?"?+". For s G R, let s+ = max(s,0) and 
let Sign(s) = 1 if s > 0, if s = 0, -1 if s < 0. Finally, for r in N \ {0} and 
b= (bi,...,b r ) inK r , let 

(11.99) 6 1/3 := (|6i| 1/3 Sign(6i), ..., |6 r | 1 / 3 Sign(6 r )). 

We now define u : R p x RPi+ n x R -> R m and v : R p x RPi+ n x R -> KP9+" by 
requiring, for (y, 2;) in R p x RPi +n and for every i in {1, . . . , q}, 

(11.100) u(y, z, t) := u*{y, t), Vt € [0, T), 

(11.101) «<(!/, z, t) := -t{t - t)+z] /3 + {t- t ) + (U - t)+y, Vt G [0, T), 
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:;n<> 



(11.102) 



(11.103) 
(11.104) 
(11.105) 
(11.106) 



<Vfi 



(y,z,t):=-t(t q -t)+z, 



+ .1/3 
9+1 



6 



(T -*)+(* -*,)+, 



(r-M s 



(z 1; ...,z g ),ViG [0,T), 



ufo,*,*) :=u(z g+ i,t-T), Vie [T,2T), 

w(v,ar,t):=0,Vte [T,2T), 

u(y,z,t) = u(y,z,t + 2T), WteWL, 

v(y, z, i) = v(y, z, t + 2T), Vi G K. 



One easily sees that u and v are continuous and vanish on {(0,0)} x R. Let (#, z) 
be any maximal solution of the closed-loop system 

(11.107) x = f(x,u(h(x, z),t)) , z = v(h(x,z),t). 

Then one easily checks that, if |a;(0)| + \z(0)\ is small enough, then 

(11.108) 

(11.109) 

(11.110) 

(11.111) 



Zi(t ) = 0, Vi g {l,...,g}, 

(z 1 (t),...,z g (t)) = ^(o;(0)), Vt€[*„3l, 

z 9+l( i g) = 0, 

6>oA'(a;(0)) = x{T), 



s?+i 



(T) 



(11.112) 
(11.113) 



x(t) = 0, ViG [2T,3T], 



z(2T + i 9 



0. 



Equalities (11.108 1 (resp. (11.110)) are proved by computing explicitly, for i G 
{1, . . . , q}, Zi on [0, to] (resp. z q+ \ on [0, t q \) and by seeing that this explicit solution 
reaches before time to (resp. t q ) and by pointing out that if, for some s in [0,fo] 
(resp. [0,£ g ]), Zi(s) = (resp. z q+ i{s) = 0), then z% = on [s, to] (resp. z q +i = 
on [s,tq]); note that ZiZi < on [0,to] (resp. z q+ ii q+1 S^Oon [0,£ 9 ]). 
Moreover, one also has, for every s in K and every t ^ s, 



(11.114) 



((x(s),z(a)) = (0,0)) =» ((«(*),*(<)) = (0,0)). 



Indeed, first note that, without loss of generality, we may assume that s G [0,2T] 
and t G [0, 2T\. If s G [0, T], then, since u* is o f class C°°, w e get, using ( |11.92[ ), that 
a;(t) = 0, Vt S [s,T] and then, using (11.82) and (11.101), we get that, for every 
i G {l,...,g}, ZiZi Sj on [s, T] and so Zi also vanishes on [s,T]; this, together 
with ( |11.102[ ) and 0(0) = (see ( |11.94[ ) and ( |11.95| ), implies that z q+ i = als o on 
[s,T]. Hence we may assume that s G [T, 2T\. But, in this case, using (11.1041, we 
get that z = 0on [s,2T] and, from (11.96) and (11.1031, we get that x = also on 

[s,2T\. 

From ( |11.112[ ), ( |11.113[ ), and ( |11.114| , we get (see Lemma 2.15 in [109 ) the 
existence of e in (0, +00) such that, for every s in R and every maximal solution 
(cc, 2;) of i = f(x, u(h(x, z), £)), z = v(h(x, 2), t), we have 



(\x(s)\ + \y( S )\^s)^((x(t),z(t)) 
Since T is arbitrary, Theorem |11.37| is proved. 



(0,0), Vt^s + 5T). 
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Remark 11.38. Roughly speaking the strategy to prove Theorem |11.37| is the 
following one. 

(i) During the time interval [0, T], one "excites" system (C) by means of 
u*(y,t) in order to be able to deduce from the observation during this 
interval of time, the state at time T: At time T we have z q+ \ = x. 
(ii) During the time interval [T, 2T], z q +\ does not move and one uses the dead- 
beat open-loop u but transforms it into an output feedback by using in its 
argument z q +\ instead of the value of x at time T (this step has been used 
previously in the proof of Theorem 1.7 of |105j ). 



This method has been previously used by Eduardo Sontag in [451 , Rogelio Lozano 
in 335J, Frederic Mazenc and Laurent Praly in 350J. A related idea is also used 
in Section 3 of [105 , where we first recover initial data from the state. Moreover, 
as in |451j and 13501 , our proof relies on the existence of an output feedback which 
distinguishes every pair of distinct states (see [466 for analytic systems and [106 
for C°° systems). 

Remark 11.39. It is established by Frederic Mazenc and Laurent Praly in [350 
that "distinguishability" with a universal time- varying control, global stabilizability 
by state feedback, and observability of blow-up are sufficient conditions for the 
existence of a time-varying dynamic output feedback (of infinite dimension and 



in a more general sense than the one considered in Definition 11.33) guaranteeing 
boundedness and convergence of all the solutions defined at time t = 0. The 
methods developed in [350 can be directly applied to our situation. In this case, 



Theorem 11.37 still gives two improvements of the results of [350. : We get that is 
asymptotically stable for the closed-loop system, instead of only attractor for time 
0, and our dynamic extension is of finite dimension, instead of infinite dimension. 

Remark 11.40. If (C) is locally stabilizable in small time by means of dynamic 
continuous periodic time-varying output feedback laws, then the origin (of W 1 ) is 
locally continuously reachable (for (C)) in small time (use Lemma 3.5 in [107 ) 
and, if moreover / and h are analytic, then (C) is locally Lie null-observable; see 
[1071 Proposition 4.3]. 

Remark 11.41. There are linear control systems which are controllable and 
observable but which cannot be locally asymptotically stabilized by means of contin- 
uous time- varying feedback laws. This is, for example, the case for the controllable 
and observable linear system, with n = 2, m = 1, and p = 1, 

ii = x 2 , x 2 = u, y = X\. 

Indeed, assume that this system can be locally asymptotically stabilized by means 
of a continuous time- varying output feedback law » : I x 1 -t M. Then there exist 
r > and r > such that, if x\ = x 2 , x 2 = u(xi,t), 

(11.115) (xi(0) 2 + x 2 {0) 2 < r 2 ) => (zi(t) 2 + x 2 {t) 2 < r 2 /5). 

Let (u n ; n € N) be a sequence of functions from 1x1 into K of class C°° which 
converges uniformly to u on each compact subset of R x i. Then, for n large 
enough, x\ = x 2 , x 2 = u n (xi,t) imply 

(11.116) (X!(0) 2 + x 2 (0) 2 ^ r 2 ) => { Xi {t) 2 + x 2 (t) 2 < r 2 /4). 
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However, since the time- varying vector field X on M 2 defined by 

Xi(xi,X2,t) = x%, X 2 {x ll x 2 ,t) = w n (a;i,t), V(xi,r 2 ,t) e R 3 , 
has a divergence equal to 0, the flow associated with X preserves area, which is a 



contradiction to (11.1161 



11.4. Discontinuous feedback laws 

In this section, we just briefly describe some results on discontinuous feedback 
laws. 

The pioneering work on this type of feedback laws is [467] by Hector Sussmann. 
It is proved in [467] that any controllable analytic system can be asymptotically 
stabilized by means of piecewise analytic feedback laws. 

One of the key questions for discontinuous feedback laws is what is the relevant 
definition of a solution of the closed- loop system. In [467] , this question is solved 
by specifying an "exit rule" on the singular set. However, it is not completely clear 



how to implement this exit rule (but see Remark 11.42 on the following page for 
this problem), which is important in order to analyze the robustness. 

One possibility, as introduced and justified by Henry Hermes in [224] (see 
also J131L 1308] ). is to consider that the solutions of the closed- loop systems are 
the solutions in the sense of Alexey Filippov [170 . Then we prove in [131] that 
a control system which can be stabilized by means of a discontinuous feedback 
law can be stabilized by means of continuous periodic time- varying feedback laws. 
Moreover, we also prove in |131] that, if the system is control affine, it can be 
stabilized by means of continuous stationary feedback laws. See also the paper 
[429] by Eugene Ryan. In particular, the control system ( jl 1 . 1| ) cannot be stabilized 
by means of discontinuous feedback laws if one considers Filippov's solutions of the 
closed-loop system. 

Another interesting possibility is to consider "Euler" solutions; see [98 for a 
definition. This is a quite natural notion for control systems since it corresponds 
to the idea that one uses the same control during small intervals of time. With 
this type of solutions, Francis Clarke, Yuri Ledyaev, Eduardo Sontag and Andrei 
Subbotin proved in [98] that controllability (or even asymptotic controllability) 
implies the existence of stabilizing discontinuous feedback laws. Their feedback 
laws are robust to (small) actuator disturbances. 

The original proof of |98] has been simplified by Ludovic Rifford in [403 . 
In this paper he shows that asymptotic controllability implies the existence of a 
semiconcave Lyapunov function. This type of regularity allows us to construct 
directly stabilizing feedback laws. His feedback laws have some new interesting 
regularity properties and the set of singularities can be made repulsive for the 
closed- loop system. In [404 Ludovic Rifford has strongly improved his regularity 
result in the case of driftless control affine systems. 

The previous papers [98] 1403] use the existence of a control Lyapunov function 
as a major step to construct discontinuous stabilizing feedback laws. A completely 
different approach for the proof of the existence of these discontinuous feedback 
laws was proposed by Fabio Ancona and Alberto Bressan in [12j . They allow us to 
consider not only the Euler solutions, but also the usual Caratheodory solutions. 
These solutions are also allowed in the paper [403] , 
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However, there is a problem of robustness of all these discontinuous feedback 
laws with respect to measurement disturbances: using a result in 99J due to Francis 
Clarke, Yuri Ledyaev and Ronald Stern, Yuri Ledyaev and Eduardo Sontag proved 
in [308] that these feedback laws are in general (e.g. for the control system ( |11.1| ) 
not robust to arbitrarily small measurement disturbances. In [308 Yuri Ledyaev 
and Eduardo Sontag introduced a new class of "dynamic and hybrid" discontinuous 
feedback laws and showed that controllability (or even asymptotic controllability) 
implies the existence of stabilizing discontinuous feedback laws in this class which 
are robust to (small) actuators and measurement disturbances. 

In order to get some robustness to measurement disturbances for the discon- 
tinuous feedback laws of the type in |98j . it has been independently proved by 
Eduardo Sontag in [459] and by Francis Clarke, Yuri Ledyaev, Ludovic Rifford and 
Ronald Stern in [97] that it is interesting to impose a lower bound on the intervals 
of time on which the same control is applied. For the robustness of the feedback 
laws constructed by Fabio Ancona and Alberto Bressan in |12j . we refer to their 
papers (131 114]. 

To take care of this problem of robustness, Christophe Prieur proposed in [393 
a new type of feedback laws, namely hybrid feedback laws. He adds discrete vari- 
ables to the continuous control system which produce hysteresis between controllers. 
An explicit example of these feedback laws is given for the nonholonomic integrator 
( |ll.l| by Christophe Prieur and Emmanuel Trelat in [394 and is generalized for 
control affine driftless systems in [395 . 

Classical discontinuous feedback laws are provided by the so-called sliding mode 
control in engineering literature. These feedback laws are smooth outside attract- 
ing smooth hypersurfaces. We refer to [491 1 by Vadim Utkin for this approach. 
For the case of the nonholonomic integrator ( |11.1| , see, in particular, [58] by An- 
thony Bloch and Sergey Drakunov. Again, it would be important to evaluate the 
robustness of this type of feedback laws with respect to measurement disturbances. 

Remark 11.42. It would be interesting to know if one can in some sense "im- 
plement" (a good enough approximation of) Sussmann's exit rule (see [467] ) by 
means of Sontag and Ledyaev's "dynamic-hybrid" strategy. Another possibility to 
implement this exit rule could be by means of hysteresis feedback laws introduced 
by Christophe Prieur in [393] . 



CHAPTER 12 

Feedback design tools 

In this chapter we give some tools to design stabilizing feedback laws for our 



control system (C) (i.e., the control system x = f(x,u) 7 see page 2881 and present 
some applications. The tools we want to describe are: 



1. control Lyapunov function (Section 12.1 1, 



2. damping (Section 12.2) 



3. homogeneity (Section 12.31 



4. averaging (Section 12.4) 



5. backstepping (Section 12.51 



6. forwarding (Section 12.6) 



7. transverse functions (Section 12.7) 



There are in fact plenty of other powerful methods; e.g., frequency-domain methods, 
zero-dynamics, center manifolds, adaptive control, etc. See, for example, |17| 1231 
H30t [1491 IT781 [2471 1288| [376] and the references therein. 

12.1. Control Lyapunov function 

A basic tool to study the asymptotic stability of an equilibrium point is the 
Lyapunov function (see, in particular, the book |24J by Andrea Bacciotti and Lionel 
Rosier) . In the case of a control system, the control is at our disposal, so there are 
more "chances" that a given function could be a Lyapunov function for a suitable 
choice of feedback laws. Hence Lyapunov functions are even more useful for the 
stabilization of control systems than for dynamical systems without control. 

For simplicity, we restrict our attention to global asymptotic stabilization and 
assume that O = R n x R m . The definitions and theorems of this section can be 
easily adapted to treat local asymptotic stabilization and smaller sets O. 

In the framework of control systems, the Lyapunov function approach leads to 
the following definition, due to Zvi Artstein 



Definition 12.1. A function V E C 1 (R n ;R) is a control Lyapunov function 
for the control system (C) if 

V{x) — » +00, as |a;| — > +oo, 

V{x) >0, Vz eET\{0}, 

Vie e R n \ {0}, 3u € R' n s.t. f(x, u) ■ W(cc) < 0. 

Moreover, V satisfies the small control property if, for every strictly positive real 
number e, there exists a strictly positive real number r\ such that, for every x £ M" 
with < \x\ < 77, there exists u £ R m satisfying \u\ < e and f(x,u) ■ W(x) < 0. 

With this definition, one has the following theorem due to Zvi Artstein [20 . 

313 
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Theorem 12.2. If the control system (C) is globally asymptotically stabilizable 
by means of continuous stationary feedback laws, then it admits a control Lyapunov 
function satisfying the small control property. If the control system (C) admits 
a control Lyapunov function satisfying the small control property, then it can be 
globally asymptotically stabilized by means of 

1. continuous stationary feedback laws if the control system (C) is control 



affine (see Definition 3.12 on page 131), 



2. relaxed controls (see 20 for a definition) for general f . 

Instead of relaxed controls in the last statement, one can use continuous peri- 
odic time- varying feedback laws. Indeed, one has the following theorem, proved in 

nan. 

Theorem 12.3. The control system (C) can be globally asymptotically stabilized 
by means of continuous periodic time-varying feedback laws if it admits a control 
Lyapunov function satisfying the small control property. 

Let us point out that, even in the case of control affine systems, Artstein's 
proof of Theorem |12.2| relies on partitions of unity and so may lead to complicate 
stabilizing feedback laws. Explicit and simple feedback laws are given by Eduardo 
Sontag in [455 . He proves: 

Theorem 12.4. Assume that V is a control Lyapunov function satisfying the 
small control property for the control system (C) . Assume that (C) is control affine, 



i.e., (see Definition 3.12 on page\131 



f(x,u) = f (x) +J2uifi(x), V(x,u) G l n x R"\ 

4 = 1 

for some f ,..., f m m C°°(K"; K n ). Then u = (m, ..., u m ) tr : 1" -> R m defined 
by 

(12.1) Ui {x) := -if f (x) ■ VV(x),f^ (/,(x) • \7V(x)f fi(x) ■ W(x), 

with 

(12.2) <p(a,b) 



if b = 0, 



is continuous, vanishes at G K™ and globally asymptotically stabilizes the control 
system (C). 

Open Problem 12.5. For systems which are not control affine, find some 
explicit formulas for globally asymptotically stabilizing continuous periodic time- 
varying feedback laws, given a control Lyapunov function satisfying the small control 



property. (By Theorem 12.3 , such feedback laws exist.) 



12.2. Damping feedback laws 

Control Lyapunov function is a very powerful tool used to design stabilizing 
feedback laws. But one needs to guess candidates for such functions in order to 



apply Sontag's formula (12.1 1. For mechanical systems at least, a natural candidate 
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for a control Lyapunov function is given by the total energy, i.e., the sum of potential 
and kinetic energies; but, in general, it does not work. 

Example 12.6. Consider the classical spring-mass system. The control system 
is 

, \ k u 

(12.3) xi = x 2 , x 2 = asi H , 

m m 

where m is the mass of the point attached to the spring, X\ is the displacement of 
the mass (on a line), x 2 is the speed of the mass, k is the spring constant, and u is 
the force applied to the mass. The state is {xi,x 2 ) tr G R 2 and the control is u £l, 
The total energy E of the system is 

E = -(kxi + mx 2 ). 
The control system can be written in the form, 

(12.4) x = f (x)+ufi(x), x= {x u x 2 ) tr £R 2 , ueR, 
with 

fo(x) := (_ X l ) , h(x) := (I) , \/x = (a*,*-,)* G M 2 . 

One has 

fo{x) ■ VE(x) = 0, Vx = (xi,x 2 ) tr £ K 2 , 

h{x) ■ VE{x) = x 2 , Vx = {x l ,x 2 ) tr e R 2 . 

Hence, if x 2 = 0, there exists no u such that (f (x)+ufi(x))-\7E(x) < 0. Therefore, 
the total energy is not a control Lyapunov function. But one has 

(f (x) + u/i(aO) • V£(x) = uh(x) ■ VE(x) = ux 2 . 

Hence, it is tempting to consider the feedback law 

(12.5) u{x) := -vVE{x) ■ fi(x) = -vx 2 , 

where v > is fixed. With this feedback law, the closed-loop system is 

xi = x 2 , 

(12.6) ± 2 = Xi x 2 , 

m m 

which is the dynamics of a spring-mass- dashpot system. In other words, the feedback 
law adds some damping to the spring-mass system. With this feedback law, 

VE(x)-(f (x) + u(x)f 1 (x))^0, 

so that (0,0) G R 2 is stable for the closed-loop system. In fact, (0,0) is globally 
asymptotically stable for this system. Indeed, if a trajectory x(t),t G K, of the 
closed-loop system is such that E{x{t)) does not depend on time, then 

(12.7) x 2 (t) = 0, Vi G E. 



Derivating (12.1) with respect to time and using (12.6), one gets 

Xl (t) = 0, Vi G K, 



which, together with (12.7) and LaSalle's invariance principle (see, for example, 
[4581 Lemma 5.7.8, page 226]j ; proves that (0,0)* r G K 2 is globally asymptotically 
stable for the closed-loop system. 
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The previous example can be generalized in the following way. We assume that 
the control system (C) is control affine. Hence 

m 

f(x,u) = fo(x)+J2 u ifi( x )> V (^ w ) e K " x R ™ 

i = \ 

for some f , . . . , f m in C°°(K"; R"). Let V G C°°(K"; K) be such that 

(12.8) V(x) -* +oo, as |ic| -» +oo, 

(12.9) F(x) > V(0), Va;eK"\{0}, 

(12.10) / o -Vy<0inK". 



Then 



/■vy^M/rW). 



Hence it is tempting to consider the feedback law u = (u\, . . . , u rn ) tr defined by 

(12.11) u 4 = -/i-VV,V*e{l > ... > m}. 

With this feedback law, one has 

ni 
f{x, u(x)) ■ VV(x) = f (x) ■ W(x) - J2(M X ) ■ VV(x)) 2 ^ 0. 

4 = 1 

Therefore, € K" is a stable point for the closed-loop system x = f(x,u(x)), that 
is, for every e > 0, there exists rj > such that 

(i = f(x,u(x)), \x(0)\ < 77) =► (|a;(t)| < e, V* > 0); 



(see (i) of Theorem 10.8 on page 280 I. Moreover, by LaSalle's invariance principle 



(see, for example, [458, Lemma 5.7.8, page 226]) G K" is globally asymptotically 
stable if the following property (V) holds. 

(V) For every x G C°°(K; K") such that 

(12.12) x(t) = fo(x(t)), Vt € R, 

(12.13) /((»(*)) ■ VV(i(t)) = 0, Vi e K, Vi G {0, . . . , to}, 
one has 

(12.14) x(t) = 0, Vt G R. 

This method has been introduced independently by David Jacobson in [250j and 
by Velimir Jurdjevic and John Quinn |261j . There are many sufficient conditions 
available for property (V). Let us give, for example, the following condition, due to 
Velimir Jurdjevic and John Quinn [261 ; see also 310J by Kyun Lee and Aristotle 
Arapostathis for a more general condition. 

Theorem 12.7. With the above notations and properties, assume that, for 
every i£l"\ {0}, 

(12.15) Span{f (x), ad k fo fi(x), i = 1, . . . ,m, k G N} = M", 

(12.16) VV(x)^0. 



Then property (V) is satisfied. In particular, the feedback law defined by (12.11) 
globally asymptotically stabilizes the control system (C). 
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3.11 



on page 



130 



(Let us recall that acL fi is denned in Definition 

Proof of Theorem |12.7| . Let us start by recalling a classical property of 
the Lie derivative (defined on page 1461: for every X G C°°(E n ; E n ), every Y G 
C°°( 



r;K n ), and every W G C°°(R n ), 
(12.17) L X {L Y W) - L Y (L X W) = L 



X,Y] 



w. 



( |12.12| and ( |12.13[ ) hold. For i G {0 

My) 



(We already used this property; see (3.65).) Let x G C°°(E;E™) be such that 

n ) and a, G C°°(E) be 



, m}, let Ai G C c 



defined by 

(12.18) 

(12.19) 



My) ■W(y) = (L fi V)(y),Wye 
ai (t) := Ai{x{t)), Vi G E. 



Using (12.12), (12.17), (12.181 and (12.19), one gets 



(12.20) di(t) = (L fo Ai)(x(t)) = (L fo (L h V))(x(t)) 

= (L [foJi] V)(x(t)) + (L ft (L fo V))(x(t)), \/t G 



From (12.10), and (12.13) for i = 0, one sees that Lf V is maximal at x(t). In 
particular, 

(12.21) (L fi (L fo V))(x(t)) = 0,Vt€R. 
From ( |12.20| and ( |12.21| , one gets 

(12.22) di(t) = (L [/oi/i] y)(x(i)), Vi G R. 

Continuing in the same way, an easy induction argument on k shows that 



(12.23) 



S k )i 



no >{t) = {L ad)gf Y){x{t)) = ad%Mx(t)) ■ W(i(t)), Vt G E, VA; G N. 



From (12.151 and (12.231, one gets 



(12.24) 



(W(x(i)) = or x(t) = 0), Vt G 



which, together with (12.16), implies (12.14). This concludes the proof of Theorem 

IPXT1 ■ 



Let us point out that the damping method is also very useful when there are 
some constraints on the controls. Indeed if, for example, one wants that, for some 
£ > 0, 

\ui(x)\ < £,Vi G {1,. .. ,m}, 



then it suffices to replace (12.11) by 



Ui {x) = -a(fi(x) ■ W(a:)), 

where a G C°(E; [— s, s\) is such that sa(s) > for every s G E\ {0}. We give an 
application of this variant in the next section (Section 12.2.1 1. 



Remark 12.8. Note that, in general, V is not a control Lyapunov function (see 
on page 313 I for the control system (C). However, under suitable 



Definition 12.1 



homogeneity assumptions on the /j's, Ludovic Faubourg and Jean-Baptiste Pomet 
constructed in 163J an explicit perturbation of V which is a control Lyapunov 
function for the control system (C). 



:ilS 
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Remark 12.9. Let us show on a simple system the limitation of this damping 
approach. Let us consider the following control system: 



(12.25) 



Xl = X 2 , x 2 



-x\ 



This control system is the classical spring mass control system (12.3) considered in 
Example 12.6 on page 315 with normalized physical constants (namely k = m 



1) 



With the Lyapunov strategy used above, let V G C°°(M 2 ; R) be defined by 

V(x) =xl + xl,\/x= (x 1 ,x 2 ) tr el 2 . 

We have 

V = 2x 2 u. 
So it is tempting to take, at least if we remain in the class of linear feedback laws, 

u(xi 7 X 2 ) = —VX2, 

where v is some fixed positive real number. An a priori guess would be that, if we 
let v be quite large, then we get a quite good convergence, as fast as we want. But 
this is completely wrong. Indeed, from now on, let us assume that v > 2. Then 



Xi(t) := exp 



+ VV 5 



a£(t) := i?(t) 



is a trajectory of the closed-loop system. Let T > be given. Then, as v — > oo, 

«i(0) = 1, a£(0) -> 0. 
However, still as v — > oo, 

x\(T) -.1^0. 
Note also that the eigenvalues of the closed-loop system are 



Ai 



vv 



A, 



' + \U 



2 2 

We have Ai < and A2 < 0, which confirms the interest of the damping. Moreover, 

lim Ai = —00. 

However, 

lim A2 = 0, 

v — >+oo 

explaining why that it is not a good idea to take v — ► +00. 

Note that, using the Kalman rank condition (Theorem 1.16 on pagercjl, one 
easily checks that the linear control system ( 12.25[) is controllable. Hence, by the 



pole-shifting theorem (Theorem 10.1 



275 I, for every A > 0, there exist 



on page 

(ki,k 2 ) tT G M 2 and C > such that, for every solution x := (xi,X2) tr of the 
closed-loop system 

±1 = x 2 , x 2 = k\Xi + k 2 x 2 , 
one has 

|s(t)| < Ce- At |a;(0)|, Vi G [0,+oo). 

This shows an important limitation of the damping method: It can lead to a rather 
slow convergence compared to what can be done. 



12.2. DAMPING FEEDBACK LAWS 



:!!<> 



12.2.1. Orbit transfer with low-thrust systems. Electric propulsion sys- 
tems for satellites are seriously considered for performing large amplitude orbit 
transfers. Let us recall that electric propulsion is characterized by a low-thrust 
acceleration level but a high specific impulse. In this section, where we follow 
|129j , we are interested in a large amplitude orbit transfer of a satellite in a central 
gravitational field by means of an electric propulsion system. 

The state of the control system is the position of the satellite (here identified 
to a point: we are not considering the attitude of the satellite) and the speed of the 
satellite. Instead of using Cartesian coordinates, one prefers to use the "orbital" 
coordinates. The advantage of this set of coordinates is that, in this set, the first five 
coordinates remain unchanged if the thrust vanishes: these coordinates characterize 
the Keplerian elliptic orbit. When thrust is applied, they characterize the Keplerian 
elliptic osculating orbit of the satellite. The last component is an angle which gives 
the position of the satellite on the Keplerian elliptic osculating orbit of the satellite. 
A usual set of orbital coordinates is 

p:= a(l - e 2 ), 

e x :=ecosuj, with w = u> + O, 

e y := esinw, 

h x := tan - cosil, 

h y := tan - sin 57, 

L := uj + v, 

where a, e, u>, f2, i characterize the Keplerian osculating orbit: 

1. a is the semi-major axis, 

2. e is the eccentricity, 

3. i is the inclination with respect to the equator, 

4. 51 is the right ascension of the ascending node, 

5. lu is the angle between the ascending node and the perigee, 

and where v is the true anomaly; see, e.g., |511| Partie A- a]. 
In this set of coordinates, the equations of motion are 



(12.26) 



dp 
dt 

de x 
~dt 

de 
~dt 
dh 



pp i 

= aJ — — \Z (si\\ L)Q + AS — e y (h x sinL — h y cos L)W] , 
[— Z(cos L)Q + BS — e x (h x sinL — h y cos L)W] 
(cos L)W, 
(sin L)W, 

(h x sin L — h y cos L) W, 
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where fi > is a gravitational coefficient depending on the central gravitational 
field, Q, S, W, are the radial, orthoradial, and normal components of the thrust 
delivered by the electric propulsion systems, and where 

(12.27) Z := 1 + e x cos L + e y sinL, 

(12.28) A :=e x + {l + Z)cosL, 

(12.29) B :=e y + {l + Z)smL 7 

(12.30) X := 1 + hi + h 2 y . 

We study the case, useful in applications, where 

(12.31) Q = 0, 
and, for some e > 0, 

|5| < £ and \W\ < e. 

Note that £ is small, since the thrust acceleration level is low. 

In this section we give feedback laws, based on the damping approach, which 
(globally) asymptotically stabilize a given Keplerian elliptic orbit characterized by 
the coordinates p, e x ,e y ,h x ,h y . 

Remark 12.10. We are not interested in the position (given by L(t)) at time 
t of the satellite on the desired Keplerian elliptic orbit. For papers taking into 
account this position, see [921 I129J , which use forwarding techniques developed 
by Frederic Mazenc and Laurent Praly in [349j , by Mrdjan Jankovic, Rodolphe 
Sepulchre and Petar Kokotovic in [254j , and in [4421 Section 6.2]; see also Section 

MM 

In order to simplify the notations (this is not essential for the method), we 
restrict our attention to the case where the desired final orbit is geostationary, that 
is, 

£ X Gy fl X fly — u. 

Let 

A= (0,+oo) x By x K 2 x R, 
where 

(12.32) B 1 = {e = (e x ,e y ) G R 2 ; e 2 + e 2 < 1}. 

With these notations, one requires that the state (p, e x , e y , h x , h y , L) belongs to A. 
We are looking for two maps 

S: A -» [-£,£] 

(Pi e £ci Cy? hxi hy, Li) i > b(p, e x ,e y , ti x , a y , L), 



and 



W : A -* [-£,£] 

(p,e x ,e y ,h x ,h y ,L) t-* W(p,e x ,e y ,h x ,h y ,L), 
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:S21 



such that (p, 0,0, 0,0) € K 5 is globally asymptotically stable for the closed-loop 



system (see (12.26) and ( 12.31 1) 



(12.33) 



dp _ p 3 1 

it ~ 2 y vz b > 



rp~ i 

— — [AS — e y (h x sin L — h y cos L) W] , 

fj, Zj 



[BS — e x (h x smL — h y cos L)W] , 
(cos L)W, 



de x 
~d~t 

de y J~p 1 

dt y /j, Z 
dh x 1 pp X 
~dT ~ 2\J Jl~Z 
dh y 1 fpX . 
— = 2V^Z (Sm L)W > 



dt 

dL 
~dt 



fj, Z 



(h x sin L — h y cos L) W, 



with (p,e x ,e y ,h x ,h y ,L) e A. 

Note that A ^ K 6 and that we are interested only in the first five variables. So 
one needs to specify what we mean by "(p, 0, 0, 0, 0) is globally uniformly asymptot- 
ically stable for the closed-loop system" . Various natural definitions are possible. 
We take the one which seems to be the strongest natural one, namely we require: 

- Uniform stability, that is, for every £q > 0, there exists E\ > such that 



every solution of (12.331 defined at time and satisfying 



|p(0) -p| + |e x (0)| + |e„(0)| + |M0)| + \hy(0)\ < ei 



is defined for every time t ^ and satisfies, for every t ^ 0, 



\p{t) -P\ + \e x {t)\ + \e v (t)\ + \h x {t)\ + \h y {t)\ < e . 



- Uniform global attractivity, that is, for every M > and for every rj > 0, 



there exists T > such that every solution of (12.33), defined at time 
and satisfying 



1 1 

p~{0) +P{0) + l-( e£C (0)2 + e ,(0) 2 ) 



+ |^(0)| + |^(0)| <M, 



is defined for every time t ^ and satisfies, for every time t ^ T, 



\p(t) -p\ + \e x (t)\ + \e y (t)\ + \h x (t)\ + \h y (t)\ < r,. 



We start with a change of "time" , already used by Sophie Geffroy in [190 . One 
describes the evolution of {p,e xi e y ,h x ,h y ) as a function of L instead of t. Then 
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system (12.33) reads 



(12.34) 



2KpS, 
= K[AS — e y (h x sinL — h y cos L)W], 



dp 

dL 
de x 

~d~L 

de 

—f = K[BS - e x (h x sin L - h y cos L)W], 

t -?«■">* 

dt _ K p 1 ? 
d-L v p 



with 
(12.35) 



K 



■^Z 3 + (h x sin L- h v cos L) VF 
p2 



Let V be a function of class C 1 from (0, oo) X B\ x R 2 into [0, oo) such that 

(12.36) V(p, e x ,e y ,h x ,h y ) = O (p, e x ,e y ,h x ,h y ) = (p, 0,0,0,0), 

(12.37) V(p, e x , e y , h x , /fy) -> +oo as (p, e x , e„, h x ,h y ) -» <9((0, +oo) x Bi x R 2 ). 



In (12.371, the boundary d((0,+oo ) x g t x R 2 ) is taken in the set [0,+co] xB]X 
[— oo,+oo] 2 . Therefore condition (12.371 is equivalent to the following condition: 
For every M > 0, there exists a compact set /C included in (0, +oo) x B\ x R 2 such 
that 

((p, e x , ej,, /i x , /i„) G ((0, +oo) xSiX R 2 ) \ K) =4> (F(p, e x , e y , h x , /i y ) ^ M). 

(One can take, for example, 



(12.38) 



V(p,e Xl e y ,h x ,h y ) 



1 (ip-p) 



5^2 



P 



1-e 2 



with e 2 = e 2 + e 2 and h 2 = h 2 x + h 2 .) 



The time derivative of V along a trajectory of ( 12.34 1 is given by 

V = K(aS + (3W), 



with 
(12.39) 

(12.40) 



dV A dV „ <9T/ 
a := 2p^- + A- h B- 



dp de x 



de. 



( 8V dV\ 

/3 := (h y cosL - h x smL) I e y - h e x - — I 

\ oe x Oe y / 

+ 2 X { {COsL) dh- x +{smL) dh- y 
Following the damping method, one defines 

(12.41) S := -cri(a), 

(12.42) W := -a 2 {l3)a s {p 1 e x ,e y ,h x ,h y ) 1 
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.a.; 



where <j\ : K — > K, o~i 
functions such that 

(12.43) 
(12.44) 
(12.45) 
(12.46) 



• R and CT3 : (0,+oo) x B\ x K — > (0, 1] are continuous 

a 1 {s)s>0, VseK\{0}, 

cr 2 (s)s>0, VseK\{0}, 

II ""I ||i°°(R)< £j 

II C2 ||l°°(R)< £, 



(12.47) a 3 (p,e x ,e y ,h Xl h y ) 



^ 



1 M (1- |e|) £ 



1 + e p 2 



\h\ 



V(p, e ai e y , /i a , ^) e (0, +00) x B x x (K 2 \ {0}). 



The reason for using a?, is to ensure the existence of K defined by (12.35). Indeed 



from (12.271, (12.341, (12.42), (12.46) and (12.471, one gets, for every L € 



f iZ 3 , 

— 2 — h (h x sin L — h y cos L) W > 



on (0,oo) x Bi x 1 and therefore K (see (12.35)) is well defined for every 



(p, e x , e y ,h x , h y , L) e (0, +00) x B x x K 2 x 



One has 

(12.48) 
(12.49) 



S 



L°°((0,+oo)xBixR 2 x 



II W ||L~((0,+oo)xeixR 2 

V < and (V = O a 



R)< £, 
/3 = 0). 



Since the closed-loop system (12.341 is L-varying but periodic with respect to L, 



one may apply LaSalle's invariance principle (see, for example, [458, Lemma 5.7.8, 
page 226]): in order to prove that (p, 0,0,0,0) is globally asymptotically stable 
on (0, +00) x B\ x R 2 for the closed-loop system (12.34), it suffices to check that 



every trajectory of ( 12.34 I such that a = f3 = is identically equal to (p, 0, 0, 0, 0). 
For suc h a traj ec tory, o ne ha s (see in particular ( |12.34[ ), ( |12.39[ ), ( |12.40[ ), ( |12.41[ ), 
fll2.42|, (|12.43|, (|12.44| and (|12.47[)) 



(12.50) 
(12.51) 

(12.52) 



dp 
dL 



de x 
~dL 



n *!» 
' dL 



2p 



dV 
dp 



A 



(h y cos L — h x sin L) 



dV 

de x 

dV 
' v de x 
1 



dh x 
~d~L ' 
dV 



B- 



de h 



dV 



dhy_ 
' dL 

= 0, 



dV dV 

2 X { {COSL) dh- + ^ L) dh-y 



0. 



Hence p,e x ,e y ,h x and /i y are constant. By (12.28) and (12.291, the left hand side 
of ( 12.51 ) is a linear combination of the functions cos L, sin L, cos 2 L, sin L cos L and 



the constant functions. These functions are linearly independent, so that 



■2 P 



dV 
dp 



dV 

de x 



2e t 



dV 
de v 



0, 



dV 
de x 



, 



dV 
de v 



0, 
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and therefore 



dV 
dp 



dV 
de-r. 



dV 
<9e„ 



0. 



which, together with (12.30) and (12.521, gives 

dV dV 
dh x dh y 

Hence it suffices to impose on V that 



(12.53) 



(VV(p, e x , e y , h x , h y ) = 0) => ((p, e x , e y , h x , h y ) = (p, 0, 0, 0, 0)) 



Note that, if V is given by (12.38), then V satisfies (12.53) 



Remark 12.11. It is interesting to compare the feedback constructed here to 
the open-loop optimal control for the minimal time problem (reach (p, 0,0, 0,0) in 
a minimal time with the constraint \u(t)\ ^ M). Numerical experiments show that 
the use of the previous feedback laws (with suitable saturations <Xj, i G {1,2,3}) 
gives trajectories which are nearly optimal if the state is not too close to (p, 0, 0, 0, 0). 
Note that our feedback laws are quite easy to compute compared to the optimal 
trajectory and provide already good robustness properties compared to the open- 
loop optimal trajectory (the optimal trajectory in a closed-loop form being, at 
least for the moment, out of reach numerically). However, when one is close to the 
desired target, our feedback laws are very far from being optimal. When one is 
close to the desired target, it is much better to linearize around the desired target 
and apply a standard Linear- Quadratic strategy. This problem is strongly related 
to Remark |12.9| on page |318| 

Remark 12.12. A related approach has been used for a Schrodinger control 
system by Mazyar Mirrahimi, Pierre Rouchon and Gabriel Turinici in [360]; see 
also [441 for degenerate cases. Note that, in the framework of a Schrodinger control 
system, the damping feedback approach is used to construct open-loop controls 



(see also Remark 12.11 ): for a Schrodinger control system, there are few quantities 
which can be measured and every measure modifies the state. 



12.2.2. Damping feedback and driftless system. Throughout this sec- 
tion, we again assume that (C) is a driftless control affine system, i.e., 



f(x,u) 






u t fi{x) 



We also assume O = R" x R m , that the fa's are of class C 
the Lie algebra rank conditions (11.45) hold. Then Theorem 



on 



and that 



11.14 



on page 



297 



asserts that, for every T > 0, the control system (C) is globally asymptotically 
stabilizable by means of T-periodic time- varying feedback laws. Let us recall that 
the main ingredient of the proof is the existence of u in C°°(]R™ x R; M m ) vanishing 
on {0} x R, T-periodic with respect to time and such that, if x = f(x, u(x, £)), then 

(12.54) x(T)=x(0), 



(12.55) If x(0) ^ 0, the linearized control system around the trajectory 

t g [0,T] t-> (x(t),u(x(t),t)) is controllable on [0,T]. 
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:!2 r , 



In this section, we want to explain how the damping method allows us to 
construct from this u a T-periodic time-varying feedback law u which globally 
asymptotically stabilizes the control system (C). We follow, with slight modifica- 
tions, |127j . which is directly inspired from |387j by Jean-Baptiste Pomet. Let 
W G C°°(R n ;R) be any function such that 

W{x) — » +00 as \x\ —> +00, 

W(x) > W(0), Va;eR n \{0}, 

(12.56) VW(x) ^0, Vi£l"\{0}. 

One can take, for example, W(x) = \x\ 2 . Let X(x,t) = ^2^ 1 u i (x,t)f i (x) and let 
$ :R"xKxt^ R™, (x,t,s) 1— > $(a;,i, s) be the flow associated to the time-varying 
vector field X, i.e., 



Of 



(12.57) 

(12.58) $(ie,s,s) =ie,V:eG R™, Vs GR. 

It readily follows from this definition that one has the following classical formula 

(12.59) *(s,t 3 ,*i) = *(*(«, *2,ti),t3,t2), Vx G R", V(ti J t 2 ,t3) G R 3 ; 



compare with (1.8 1. Note that by (12.541, 

(12.60) f(i,0,T) = $(i,0,0)=i,Vie 
Let us now define V G C°°(R n x R; R) by 

(12.61) V(x,t) = W(®(x,0,t)). 



By (12.60 I, V is T-periodic with respect to time and one easily checks that 
V(x,t) > V{0,t) = W(0),\/(x,t) G (R"\{0}) xR, 
lim Min{T/(a;, t); t G R} = +00. 

\x\ — >+oo 



From (12.591 with t\ := t, £2 := r + t and £3 := 0, and (12.611, we have 
(12.62) V($(x, t + t,t), t + t) = W($(x, 0, £)), Va; G R", V(t, r) G R 2 . 



Differentiating (12.62) with respect to r and then letting r = 0, we get, using 
(Il2~57l and (112.58b , 



(12.63) 



<9V 



X- W = 0. 



From (12.63), along the trajectories of X = ^2j = i{iM + Vi)fi(x), the time derivative 

dV 



V of V is 



V 



Q2(ui + Vi)fi)-VV 

i=\ 



(12.64) 



dt 

m 

X>(/i-w) 



j=i 



Hence, as above, one takes vt(x, t) = —fi(x)-W(x, t), which, together with (12.64 1, 
gives 

m 

\2 



v = -Y J (.m-vv{xM 



One has the following proposition. 
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Proposition 12.13. The feedback law u 
bilizes the control system (C). 



u + v globally asymptotically sta- 



Proof of Proposition |12.13 , By the time-periodic version of the LaSalle 
invariance principle (see, for example, [4141 Theorem 1.3, Chapter II, pages 50- 
51]), in order to prove that u = u + v globally asymptotically stabilizes the control 
system (C), it suffices to check that every solution x : M. — > M™ of x = X(x,t) such 
that 



(12.65) 

satisfies 

(12.66) 

Let we C°°([0,T]; 



fi(x(t)) ■ VV(x(t),t) = 0, Vt G R, Vi G {1, . . . , m}, 



5(0) =0. 
) be defined by 

u(t) := u(x(t),t), Vt £ K. 
Let ie C°°([0,T];/:(R";K")) and -B e C°°([0,T]; £(1 



l )) be defined by 



(12.67) 
(12.68) 



df 

A(t):=^(x(t),u(t)),Vte[0,T}, 

df 
B(t)i=Mx(t)M)),W€[0,T\. 



du 

The map t € [0,T] i— > (a;(i),u(i)) G K" x K m is a trajectory of the control system 
(C) and the linearized control system around this trajectory is the time-varying 
linear control system 

(12.69) x = A(t)x + B(t)u, t e [0,T], 

where the state is x € W 1 and the control is u G 



We assume that (12.661 does 



not hold. Then, by ( |12.55[ ) 
(12.70) 



the linear control system (12.69) is controllable 



Let A e C oo ([0,T];£(K n ;M Tl )) be defined by 

dX 



(12.71) 
We have 

Mm 



Ait) :- 



Ox 



(x(t),t),yte[o,T}. 



i-j n Til j-j — 

' J (x(t),u(t))Z + E -^(«(*). *)e/<(*(*)), Vt e [0, T], ve e 



(?:)' 



i=l 



<9.r 



In particular, there exists K e C°°([0, T]; £(R n ; M m )) such that 

(12.72) A(t) = A(t) + B(t)K(t), Vt G [0, T]. 
Let us consider the time- varying linear control system 

(12.73) x = A(t)x + B{t)u, t G [0,T], 

where the state is a; G K n and the control is u G K m . Note that, if t G [0, T] 



(a;(t), w(t)) G R" x R m is a trajectory of the linear control system (12.69), then 
t G [0,T] n-> (a:(t),it(t) - K(t)x(t)) G R" x K m is a trajectory of the linear control 



system (12.73|). Hence, using also (|12.70|, we get that 
(12.74) 



the linear control system (12.73) is controllable 
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Let R : [0,T] x [0,1] -* £(R";R"), (t,s) i-> R(t,s), be the resolvent of the time- 
varying linear differential equation y = A(t)y, t G [0, T], i.e., 



dR 
~dt 



A(t)R on [0,T] x [0,7], 



R(s,s)x = x, W(s,x) G [0,T] x 
see Definition 1.4 on pageEJ By (12.61) one has 

(12.75) 



d<5> 



(\7V(x(t),t))^ = Vlf(x(0)) h -(i(t),0,t), Vi G [0,31. 



Let us assume, for the moment, that 
9$ 



(12.76) 



<9:E 



(x(t),0,t) = R(0,t), VtG [0,T]. 



From (12.651, (12.681, (12.751 and (12.76), we get 



(Vlf(i(0))) tr fi(0,t)B(t) = 0, Vt G 



In particular, 



(VW(z(0))) tr / R{0,t)B{t)B(t) tI R{0,t) t ' : dt (VW(a(0))) = 0, 



which, by (12.561, shows that the nonnegative symmetric matrix 

C:= / R{0,t)B(t)B(t) tr R(0,t) tT dt 
Jo 

is not inyertible. But, by Theorem |1 . 1 1 1 on pageRJJ the time- varying linear control 

system ( | 12. 73 1 is con trollable on [0, T] (if and) only if R(T, 0)CR(T, 0) tr is invertible. 

Hence, using (12.74), one gets a contradiction. 

It remains to check that (12.76) holds. Using (12.59) with t\ := t, ti = 0, and 

£3 := t and (12.581 with s = t, we get 

(12.77) $($(x,0,i),t,0) = $(x,M) = x,^x G 



ViG 



Differentiating (12.771 with respect to x and then letting x := £(£), one has 

(12.78) 



<9$ 9$ 

— (x(0), t, 0) o —($(t),0, t) = Id n , Vt G [0, T], 



where, as above, Id„ denotes the identity map of R™. Let H G C°°([0,7); £(R n ;R n )) 
be defined by 

9$ 



(12.79) 



#(*):= ^(s(0),t,0),Vte[0,T|. 



Differentiating (12.57) with respect to x and using (12.71), one has, for every t G 
[0,31, 



ff(i) 



(12.80) 



ax 

<9X 



dx 

A(t)H(t) 



(*(s(0),t,0),t)ff(t) 

(x(t),t)H(t) 
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Differentiating (12.58) with respect to x and then choosing x := x(0) and s := 0, 
one gets 



(12.81) 



H(0) = Id, 



From ( |12.80| and ( |12.8l| , one gets 

(12.82) if(t) = R(t, 0), Vi e [0, T}. 



Equation (12.76) follows from property (1.9 1 of the resolvent, (12.781, (12.791 and 



(12.82 |. This concludes the proof of Proposition 12.13 



12.3. Homogeneity 

Let us start by recalling the argument already used in the proof of Theo- 



rem 



10.14 



on page 



i.e., the linear control system 



281 Consider the linearized control system of (C) around (0, 0), 

±= fx^ )X+ fu^^ 

where x € W 1 is the state and u G K m is the control. Assume that this linear 
control system is asymptotically stabilizable by means of a linear feedback law 
u(x) = Kx with K G 



l ). By Theorem 10.9 



on page 



280 



and Theorem 



10.10 



on page 280 this feedback law locally asymptotically stabilizes the control system 

(C). 

The idea of "homogeneity" is a generalization of the above procedure: one 
wants to deduce the asymptotic stabilizability of the control system (C) from the 
asymptotic stabilizability of a control system which is "simpler" than the control 
system (C). 

Let us now give the definition of a homogeneous vector field. Since we are going 
to give an application to periodic time-varying feedback laws, the vector fields we 
consider depend on time and are T-periodic with respect to time. The vector fields 
are also assumed to be continuous. Let r = (n,... ,r n ) € (0, +oo)". One has the 
following definition (see Lionel Rosier's Ph.D. thesis |4061 Chapitre 3] for various 
generalizations) . 

Definition 12.14. The vector field X = (Xi, . . . ,X„) tr is r -homogeneous of 
degree 0, if, for every e > 0, every x € K™, every i G {1, . . . , n}, and every t £ K, 



J\-iy£ Xi,...,c X n ^tJ 



l Xi(xi 



, X n , T J . 



Since the degree of homogeneity will always be in this section, we shall omit 
"of degree 0" . 

Example 12.15. 1. (Linear systems.) The vector field X(x,t) = A(t)x with 
A(t) e £(R";R") is (1,..., 1) -homogeneous. 

2. Take n = 2 and X{xi,X2) = (x% — cc|, ^2) - Then X is (3,l)-homogeneous. 

For applications to feedback stabilization, the key theorem is: 

Theorem 12.16. Let us assume that 

(12.83) X = Y + R, 
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:!2'l 



where Y and R are continuous T-periodic time-varying vector fields such that Y 
is r -homogeneous and, for some p > 0, r] > and M > 0, one has, for every 
i G {1, . . . , n}, every e G (0, 1], and every x = (xi, ■ ■ ■ , x n ) G W 1 with \x\ Sj p. 



(12.84) 



|^(£ ri ^i, 






,t)\<Me r '+v. 



If is locally (or equivalently globally) asymptotically stable for x = Y(x,t), then 
it is locally asymptotically stable for x = X(x, t). 



This theorem has been proved by Henry Hermes in [229j when one has unique- 
ness of the trajectories of x = Y(x), and in the general case by Lionel Rosier in 
[405] . In fact, [405 , as well as [229 , deals with the case of stationary vector fields. 
But the proof of [405 can be easily extended to the case of periodic time-varying 
vector fields. Let us briefly sketch the arguments. One first shows that Theorem 



12.16 is a corollary of the following theorem, which has its own interest and goes 
back to Jose Massera 13461 when the vector field is of class C . 



Theorem 12.17 ( |405j by Lionel Rosier and |388| by Jean-Baptiste Pomet and 
Claude Samson). Let Y be a continuous T-periodic time-varying vector field which 
is r -homogeneous. We assume that is locally (=globally) asymptotically stable for 
x = Y(x, t). Let p be a positive integer and let 

k G (p Max{r i7 1 Sj i Sj n},+oo). 

Then there exists a function V G C°°((K™ \ {0}) xM;R)fl C p {R n x I 

V(x, t) > V(0, t) = 0, V(x, t) G (R™ \ {0}) x K, 
V(x, t + T) = V{x, t), \f(x, f)6l"x K, 



such that 



(12.85) 

(12.86) 
(12.87) 



lim Min {V(x,t);t G K} = +oo, 

\x\— >+oo 

dV 
~dt 



V{e ri Xl 



+ Y ■ VV < in (R™ \ {0}) x K, 

, S X n7 TJ — S V \X\, ■ ■ ■ , X n , t) , 

\/(e,x,t) G (0,+oo) x 



Proof of Theorem 



Theorem 12.17 For x 
(12.88) 



12.16 



(.)-! 



Let us deduce, as in |405j . Theorem 12.16 from 
x n ) G W 1 and e > 0, let 



6 r e (x) = {e ri Xl 



Let V be as in Theorem 12.17 with p = 1. From (12.861, there exists v > such 
that 



(12.89) 



fdV \ 



€ 



for eve ry t G [0, T] and every x G K" such that |xi| 1/ri + . . . + |a;„| 1/r " 
(12.871 and the assumption that Y is r-homogeneous, we get that 



1. From 



(12.90) 



dV 
~dt 



Y-w)(S r E (x),t) 



dV 
~dt 



+ Y-VV)(x,t), V(e, x, t) G (0, +oo) x K" x 



.Till 
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From fll2.89| and ( |12.90| , we get 
(12.91) 



(dV 

\dt 



+ Y ■ w\ (x,t) < -v (\ Xl \ 1 ^ +... + {x^y , V(x,t) 



x[0,T]. 



Using (12.841 and (12.87), similar computations show the existence of C > such 
that 

(12.92) (R ■ VV)(x,t) < C (l^l 1 /'' 1 + . . . + Ix^y^ , 



for eve ry t e [0,T] and every x G K™ with |z| < p. From ( |12.83[ ), ( |12.91| and 
(12.92 I, we get the existence of p' > such that 

[-KT + X- WJ (x,t) <0, Vie [0,T], VxeR" withO< |ar| < p', 



which concludes the proof of Theorem |12.16| 



Sketch of the proof of Theorem 12.17 We follow the proof given in [405 
by Lionel Rosier for stationary vector fields and extended by Jean-Baptiste Pomet 
and Claude Samson in [388 to the case of time- varying vector fields. By Kurzweil's 
theorem [289], there exists W e C°°(E n x M;E) such that 

W{x,t) > W(0,t) = 0, \/(x,t) e (K" \ {0}) x R, 
W(x, t + T) = W(x, t), V(x, t) e R" x R, 

lim Min {TU(a;, i);tei} = +oo, 



9T¥ 



+ Y -VW <0in (K n \{0» x 



Let a e C°°(R;K) be such that a' ^ 0, a = in (-00, 1] and a = 1 in [2,+oo). 
Then one can verify that V, defined by 



V(x,t) 



+oo 



1 



ofc + 



T a{W{s ri xi,...,s rn x n ,t))ds 7 V(x,i) eK" x 



satisfies all required conditions. This concludes the sketch of proof of Theorem 
lT2~T7l ■ 



Example 12.18. Following [126], let us give an application to the construction 
of explicit time-varying feedback laws stabilizing asymptotically the attitude of a rigid 



body spacecraft, a control system already considered in Example \3.H{ on page \128[ 
Example \3.35\ on page \144\ Example \10.15\ on page \282\ Example 11. 3\ on page 289\ 
and Example 11.31 on page 304 S° the control system is given by (3.12) with 



b\, . . . , b m independent and 1 ^ m ^ 3. Here we assume that m = 2. Without loss 
of generality, we may assume that 

{vih + v 2 b 2 ; ( Vl ,«a) e K 2 } = {0} x R 2 . 



So, after a change of control variables, (3.12\ can be replaced by 
(12.93) wi = Q(w)+wiLi(w), w 2 = V 1 , ^ 3 = V 2 , j) = A(ti)uj, 



12.3. HOMOGENEITY 331 



with Liu; = Dilu 1 + Eill> 2 + F1UJ3, Q(u>) = Auj2+Buj2lu 3 + Clu 3 . For system (12.93), 
the controls are V\ and V 2 ■ It is proved in [272] that Q changes sign if and only if 
the control system \3. 12\ satisfies the Lie algebra rank condition at (0, 0) 6 I 6 x R 2 



which, by Theorem \3 . 1 7| on page 134 is a necessary condition for small-time local 
controllability at (0,0) G R 6 x K 2 . From now on we assume that Q changes sign 
(this is a generic situation) . Hence, after a suitable change of coordinates of the 
form 

(12.94) to = PCo = 




system (12.93) can be written as 

(12.95) lui = lo 2 lo 3 +loiL 2 (Co), u> 2 = u i, ^3 = "2, V = Mji)Pu, 

with L2C0 = D2CJ1 + E2LU2 + F2CJ3. Let c = det P. We can always choose P so that 
c > 0. Let 

xi = wi, x 5 = Co 2 , x 6 = ui 3 , x 3 = -(d p 9 - b p ip), 

I n 1 ; \ j. I- ' P 2 a p c p 2 7, 
X4 = -{-CpO + a p 1p), X 2 = (p ^—£4 7T~ x 3 - 0pC p X 3 X4. 

In these coordinates, our system can be written as 

(12 QQ) ( Xl= X 5 X 6 + Rl{x), X 2 = Xi + cx 3 x 6 + R 2 {x), 

\ x 3 = x 5 + R 3 {x), x 4 = x 6 + R t (x), £5=1*1, x 6 = u 2 , 

where R±, R 2 , R 3 , and R4 are analytic functions defined on a neighborhood of 
such that, for a suitable positive constant C, one has, for every x in R 6 with \x\ 
small enough, 

\Ri(x)\+ \R 3 (x)\ + \R 4 (x)\ ^ C (lanl + \x 2 \ + \x 3 \ 2 + \ Xi \ 2 + \x 5 \ 2 + \x 6 \ 2 f 2 , 

\R 2 (x)\ < C (|xi| + \x 2 \ + \x 3 \ 2 + \ Xi \ 2 + \x 5 \ 2 + \x 6 \ 2 f , 

Hence our control system can be written as 

(12.97) x = f(x,u) = X{x)+R(x) + uY, 

where x = (x\, . . . ,XQ) tr G R 6 is the state, u = {ui,U2) tr G R 2 is the control, 
(12.98) 
uY = uiYx + u 2 Y 2 = (0,0,0, 0,ui,u 2 ), X(x) = (x 5 x Q ,xi + cx 3 x 6 ,x 5 ,x 6 , 0,0), 

where c G (0,+oo) is a constant, and R := (R\, ■ ■ ■ , Re) is a perturbation term 
in the following sense. Note that X is (2,2,1,1,1, 1) -homogeneous and that, for a 
suitable constant C > 0, the vector field R satisfies, for every e in (0, 1) and for 
every x = {x\, . . . ,x§) in R 6 with \x\ ^ 1, 

\Ri(6 e (x))\^C e 1+r ', Vie{l,...,6}, 

with 

5 e {x) := (e 2 Xi,e 2 X2,£x 3 ,ex4 : ,ex 5 ,ex e ). 

Keeping in mind this (2,2, 1, 1, 1, 1) -homogeneity and Theorem 12.16, it is natural 
to consider time-varying feedback laws u which have the following property: 

(12.99) u(5 £ {x),t) = su(x, t),\/x e R 6 , Vi G R. 



:',:i2 
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Indeed, assume that u is a periodic time-varying feedback law satisfying (12.99) 
which locally asymptotically stabilizes the control system 



(12.100) 



x = X(x) + uY. 



(By homogeneity, this local asymptotic stability is equivalent to global asymptotic 
stability.) Then, from Theorem 12.16 u locally asymptotically stabilizes the control 
system (12.97). We shall give in sections 12.4 an d 12.5 a method, due to Pascal 



Morin and Claude Samson [364|, to construct a periodic time-varying feedback law 



u satisfying (12.99) which locally (=globally) asymptotically stabilizes control system 



(12.100); see also [126J for another method to construct such feedback laws. 



Remark 12.19. Let us point out that, as shown by Lionel Rosier in [406 
Part A, Chapter II] and by Rodolphe Sepulchre and Dirk Aeyels in |441j . there 
are homogeneous control systems which can be asymptotically stabilized by means 
of continuous stationary feedback laws and cannot be asymptotically stabilized 
by means of continuous homogeneous stationary feedback laws. An obstruction 
to the asymptotic stabilization by means of continuous homogeneous stationary 
feedback laws is given in [113( Proposition 3.6, page 374]. Let us also mention that 
homogeneity can be used for stabilization in finite time; see [54] by Sanjay Bhat 
and Dennis Bernstein. 

Remark 12.20. For more information on the homogeneity techniques in con- 
trol theory, see, in particular, [llj by Fabio Ancona, [24 1 Section 5.3] by Andrea 
Bacciotti and Lionel Rosier, |143j by Wijesuriya Dayawansa, Clyde Martin and 
Sandra Samelson, [229] I230J by Henry Hermes, [255j by Hamadi Jerbi, |268j by 
Matthias Kawski, [493 by Marilena Vendittelli, Giuseppe Oriolo, Frederic Jean, 
and Jean-Paul Laumond, and the references therein. 



12.4. Averaging 



Let us start with the following classical result (see, e.g., [273, Theorem 7.4, 
page 417]). 

Theorem 12.21. Let X be a T-periodic time-varying vector field of class C 2 . 
Assume that the origin is locally exponentially asymptotically stable for the "aver- 
aged" system 

1 f T 
(12.101) x= - / X{x,t)dt. 



Then there exists eo > such that, for every e € (0,£o] 7 the origin is locally 
asymptotically stable for x = X(x,t/e). 

By "locally exponentially asymptotically stable" , one means the existence of 
(r, C, A) € (0,+oo) 3 such that \x(t)\ < C|.x(0)| exp( — Xt) for every solution x of the 
averaged system (12.1011 satisfying |x(0)| 5j r. This is equivalent (see, e.g., [273 
Theorem 4.4, page 179]) to the following property: the origin is asymptotically 
stable for the linear system 



(0,t)dt)y. 




12.4. AVERAGING 
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In the case of homogeneous vector fields, this theorem has been improved by 
Robert M'Closkey and Richard Murray in [351] . They have proved the following 
theorem. 

Theorem 12.22. Let X be a continuous T-periodic time-varying feedback law 
which is r -homogeneous (of degree 0). Assume that the origin is locally (=globally) 



asymptotically stable for the averaged system (12.101). Then there exists £q > 



such that, for every e € (0, £o]> the origin is locally asymptotically stable for x 
X(x,t/s). 



Pascal Morin and Claude Samson gave in [364 a proof of this theorem which 
provides us with a value of So if X has the following form: 



X(x,t) 



fo(x) + Y /9i (t)f i (x). 



1=1 



Example 12.23. Following [364 , let us give an application of this theorem to 
the construction of explicit time-varying feedback laws stabilizing asymptotically the 
attitude of a rigid spacecraft with two controls. In Example \12.18\ on page \33(3\ we 
reduced this problem to the construction of a periodic time-varying feedback law u 



satisfying (12.99) which locally (=globally) asymptotically stabilizes the control sys- 



tem (12.100). Now the strategy is to construct a periodic time-varying feedback law 



with the "proper homogeneity" which globally asymptotically stabilizes the control 
system 



(12.102) 



Xi = X 5 X G , X 2 = Xl + CX 3 X 6 , X 3 = X5, X4=X 6 , 



where the state is (xi,x 2 ,x 3 ,Xi) G R 4 and the control is (x§,xq) G 
homogeneity" we mean that, for every t in K, every (xi, X2, X3,Xi) in 



By "proper 
every e 



in (0, +00), and i = 5 or 6, 

(12.103) Xi{e x\, e 2 x 2l ex 3l exi, t) = exiixx, x 2 , x 3 , X4, i). 

Using the backstepping method explained in the following section, we shall see, in 



Example 12.26 



on page 

x R 



331 how to deduce, from such a feedback law (x^^Xq), a 
feedback law u : K 6 x K — > M 2 , (x\,X2,X3, X4,,X5,X6,t) — > u{x\,X2,x 3 , X4_,x§,XQ,t) 
which is periodic in time, has a good homogeneity, and globally asymptotically sta- 



For x 

x 5 e C°(K 

(12.104) 



i) and x 6 e C°(E 4 x 



_(x?H 
be defined by 

2 



bilizes the control system obtained from the control system (12.102) by adding an 
integrator on x§ and on Xq, i.e., the control system (12.100) 
(xx,X2,X3,X4,) G K 4 , let p = p(x) 



4) 1/4 - 



Let 



x 5 



-X3 — psm ■ 



X 6 



Xi H — (xi + x 2 )sin 



Then the closed-loop system (12.102)-(12.104) is (2, 2, 1,1) -homogeneous and its 
corresponding averaged system is 



(12.105) 



Xl 



Using Theorem 10.10 



■■ -Xl - x 2 , x 2 
on page 



Xl — CX3X4, X3 



-X 3 , Xi 



-Xi. 



280, one gets that G R is locally asymptotically 



stable for system (12.105). Then, by Theorem 12.22, the feedback law (12.104) 
locally asymptotically stabilizes the control system (12.102) if e is small enough. 



:m 
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12.5. Backstepping 

For the backstepping method, we are interested in a control system (C) having 
the following structure: 



(12.106) 
(12.107) 



±i = fx{xi,x 2 ), 

±2 



u, 



where the state is x = (x\,x 2 ) tT G 



pni+m 



l n with {x 1 ,x 2 ) G 



and the 



control is u G R m (see (11.19) for the definition of (xx,X 2 ) tT ). The key theorem for 



backstepping is the following one. 

Theorem 12.24. Assume that /i G C 1 ( 
system 



(12.108) 



xi = fi(xi,v), 



where the state is x\ G K™ 1 and the control v G '. 

stabilized by means of a stationary feedback law of class C . Then the control system 



and that the control 



can be globally asymptotically 



(12. 106)-( 12.107) can be globally asymptotically stabilized by means of a continuous 



stationary feedback law. 

A similar theorem holds for time-varying feedback laws and local asymptotic 
stabilization. Theorem |12.24| has been proved independently by Christopher Byrnes 
and Alberto Isidori in [79 1, Daniel Koditschek in [276 and John Tsinias in [485 . 
A local version of Theorem 12.24 has been known for a long time; see, e.g., [494 
by Mathukumalli Vidyasagar. 



Proof of Theorem |12.24[ We give the proof of [79l 12761 1485] ; for a different 
method, see |453] by Eduardo Sontag. Let v G C 1 (R" 1 ;R m ) be a feedback law 



which globally asymptotically stabilizes G R" 1 for the control system (12.1081 



Then, by the converse of the second Lyapunov theorem (due to Jose Massera [346 
there exists a Lyapunov function of class C°° for the closed- loop system x\ : 
fi(xi, v(xi)), that is, there exists a function V G C°°(]R ni ;]R) such that 

(12.109) /i(*i,v(ai)) ■ W(si) < 0, Vzi G R" 1 \ {0}, 

V(xi) — * +00 as |xi| — > +00, 
V(xi) > V(0), V« x GR ni \{0}. 



A natural candidate for a control Lyapunov function (see Section 12.1 1 for the 



control system (|12.106|-(|12.107|) is 
(12.110) 



1 



W(( Xl ,x 2 ) tT ) := V( Xl ) + t\x 2 - v( Xl )\ 2 , \f(x u x 2 ) G R" 1 x R m . 
Indeed, one has, for such a W , 

(12.111) W((:ri,a;2) tr ) -» +oo as \xi\ + \x 2 \ -* +oo, 

(12.112) W{( Xl ,x 2 ) tr ) > W(0,0), V(xi,x 2 ) G (R ni x R m ) \ {(0,0)}. 
Moreover, if one computes the time-derivative W of W along the trajectories of 



( |12.106[ )-( |12.107| , one gets 

(12.113) W = fi(x!,x 2 ) ■ VV(xi) - (x 2 - v(xi)) ■ (v'(xi)fi(xi,x 2 ) - u). 
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:;:; r , 



Since /i is of class C\ there exists G G C°(R ni x R m x R m ; 
(12.114) 

fi(xi,x 2 ) - fi(xi,y) = G(xi,x 2 ,y)(x 2 - y), V(xi,x 2 ,y) e 



L )) such that 



By (12.113) and (12.1141 



W = f 1 (x l ,v(xi))-W(x 1 ) 

+ [u tr - {v'{x x )h{x 1 ,x 2 )) tt + (VV(x 1 yfG(x 1 ,x 2 ,v(x 1 ))}(x 2 - v( Xl )). 



Hence, if one takes as a feedback law for the control system ( 12.106 1-( 12.107) 

(12.115) u := u'frO/ifri.aa) - G(x u x 2 , V (cci)) tr W(zi) - (x 2 - v{x x )), 

one gets 

W = h{x u v[xi)) ■ VV( Xl ) - \x 2 - v( Xl )\ 2 



which, together with (12.1091, gives 



W(( Xl ,x 2 f) < 0, V(a;i,s a ) G (»"' x K m ) \ {(0,0)}. 



Hence, the feedback law (12.115) globally asymptotically stabilizes the control sys- 



tem (12.106 (-(12.1071. This concludes the proof of Theorem 12.24 



Let us point out that this proof uses the C 1 -regularity of f\ and v. In fact, one 
knows that Theorem |12.24| does not hold in the following cases: 

- The map f\ is only continuous; see |131[ Remark 3.2]). 

- One replaces "stationary" by "periodic time- varying" and the feedback law 



which asymptotically stabilizes the control system ( 12.108 ) is only assumed 
to be continuous; see [1311 Proposition 3.1]. 



One does not know any counterexample to Theorem 12.24| when the feedback 
laws which asymptotically stabilize the control system ( 12.108 ) are only continuous. 



But it seems reasonable to conjecture that such counterexamples exist. It would 
be more interesting to know if there exists a counterexample such that the control 



system (12.108) satisfies the Hermes condition S(0) (see page 143). Let us recall 
(see Proposition 3.30 on page 



143) that, if the control system (12.1081 satisfies 



the Hermes condition, then the control system ( 12.106 )-( 12.1071 also satisfies the 



Hermes condition, and so, by Theorem |3.29| is small-time locally controllable at 

(0,0) ew n x E m . 

12.5.1. Desingularization. In some cases where v is not of class C 1 , one 
can use a "desingularization" technique introduced in [392:. Instead of giving the 
method in its full generality (see |392j for a precise general statement), let us 



explain it on a simple example. We take n\ 



1 and fi(xi,x 2 ) = X\ — 2xi, 



the control system (12.108) is 

(12.116) x 1 =x 1 -2v 3 , 

where the state is x\ G TBL and the control is v G K. Clearly the feedback law 
v(xi) := x x := |xi| 1 ' 3 Sign(a;i) globally asymptotically stabilizes the control sys- 
tem (12.1161. Matthias Kawski gave in [269] an explicit continuous stationary 



feedback law which asymptotically stabilizes the control system ( 12.106 I- (12. 107) 



(and other control systems in the plane). In our situation, this control system is 
(12.117) x l = x l 



2x\, x 2 



:«(i 
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where the state is x 



{xi,x 2 ) 



and the control is u € 



Note that the 



control systems (12.1161 and (12.1171 cannot be stabilized by means of feedback 



laws of class C 1 (see also [142] by Wijesuriya Dayawansa and Clyde Martin, for 
less regularity). Moreover, the construction of a stabilizing feedback law u given in 
the proof of Theorem 1 1 2 . 24| leads to a feedback law which is not locally bounded. 
Let us explain how the desingularization technique of [392 j works on this ex- 
ample (the Kawski construction given in [269 is different). Let V € C°°(K;K) be 
defined by 

1 



V(xi 



Vxi e 



Let us first point out that the reason for the term (1/2) \x 2 — v(xi)\ 2 i n the control 
Lyapunov function (12.110) is to penalize x 2 ^ v(x\). But, in our case, x 2 = v(xi) 



is equivalent to x 2 = X\. So a natural idea is to replace the definition of the control 



Lyapunov function (12.1101 by 



W(( Xl ,x 2 ) tr ) := V(xi) + I (s :i - xi)ds 



XiX 2 



|4/3 



With this W, one again has (12.1111 and (12.1121. Moreover, one now gets 



W 



-x\ + (x 2 



„i/3 



)[(* 



1/3 



Xn 



+ |zi| 2/3 )(u - 2{x x - x 2 + x\ /3 )) + 



x x \ 



Hence, if one takes for u the continuous function defined by 



u((xi,x 2 ) tT ) :=2( Xl 
if (xi,x 2 ) jtz (0,0) and 



x 2 



„!/3n 



X\ 



1/3 



x 2 



\ X1 \ 2 ^ 



{x 2 



1/3n 



«((«!, x 2 ) tr ) := if (x x ,x 2 ) = (0,0), 

one gets W = -x\ - (x 2 - x\ /Z ) 2 {x 2 2 + x\ /3 x 2 + |cci| 2 / 3 ) < for (x 1} x 2 ) ^ (0,0). 
Hence the feedback law u globally asymptotically stabilizes the control system 



(12.116) 



One can find in Section |13.2| an application of this desingularization technique 
to the stabilization of a nonlinear partial differential equation. 

12.5.2. Backstepping and homogeneity. Note that, in order to construct 
u as in the proof of Theorem |12 ,24| one does not only need to know v; one also needs 
to know a Lyapunov function V . In many situations this is a difficult task. Lionel 
Rosier in [406, Chapitre VI] (see also [24, Proposition 2.19 page 80 and Section 2.6]) 
and Pascal Morin and Claude Samson in [364 have exhibited interesting situations 
where one does not need to know V . Let us briefly describe Morin and Samson's 
situation. It concerns homogeneous control systems, with homogeneous feedback 
laws, a case already considered in [128] but where the method introduced does not 
lead to explicit feedback laws. Pascal Morin and Claude Samson have proved in 
[364] the following theorem. 

Theorem 12.25. Let T > 0. Assume that there exists a T-periodic time- 
varying feedback law v of class C 1 on (K™ 1 xl)\ ({0} x K) which globally asymp- 
totically stabilizes the control system (12.108). Assume also that there exist r = 
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:S.",7 



(n, 



e(o, 



and q > such that the closed-loop vector field (xi,t) 



fi(xi, v(xx, t)) is r-homogeneous (of degree 0) and that, with the notation of ( 12.88), 

v{8 r e (xi),t) =e q v(xi,t), \f(e,xi,t) £ (0,+oo) xl" 1 x E. 
Then, for K > large enough, the feedback law u := —K(x2 — v(xi,t)) globally 



asymptotically stabilizes the control system (12.106)-(12.10 r l) 



Example 12.26. (This example is due to Pascal Morin and Claude Samson 
|364j . ) Let us go back again to the stabilization problem of the attitude of a rigid 
spacecraft, already considered in Examples \3.9\ on page \128\ \1 1.3\ on page \289}\11.31\ 
on page \304[ \12.18\ on page \330\ and \12.23\ on page \333\ It follows from these 
examples and Theorem 12.25 that the feedback law 



»i 



-K(x 5 - x 5 (x 1 ,X2,x 3 ,x 4 ,t)), u 2 := -K(x 6 - x 6 (x 1 ,x 2 ,x 3 ,x 4 ,t)), 



where x 5 and Xq are defined by (12.103) and K > is large enough, locally asymp- 



totically stabilizes the control system (12.91), i.e., the attitude of the rigid spacecraft 



12.6. Forwarding 

The pioneering works for forwarding techniques are |477l 1478] by Andrew Teel, 
[349] by Frederic Mazenc and Laurent Praly (see also [391 by Laurent Praly for a 
more tutorial presentation) and [254 by Mrdjan Jankovic, Rodolphe Sepulchre and 
Petar Kokotovic. There are essentially two types of approaches for these techniques: 

1. An approach based on the asymptotic behavior of interconnected systems. 
This approach has been introduced by Andrew Teel in |477| I478J . 

2. An approach based on Lyapunov functions. This approach has been intro- 
duced independently by Frederic Mazenc and Laurent Praly in [349], and 
by Mrdjan Jankovic, Rodolphe Sepulchre and Petar Kokotovic in 254 . 
See also |442| Section 6.2] by Rodolphe Sepulchre, Mrdjan Jankovic and 
Petar Kokotovic for a synthesis. 

Here we follow the Lyapunov approach and more precisely [349| . We do not try to 
give the more general framework but only explain the main ideas of [349 . 
Let us consider the following control system 

(12.118) x = f(x,u),y = g(x,u). 

For this control system, the state is (x, y) tr £ R n+P , with (x, i/)£l"x R p , and the 
control is u G K m (see (11.191 for the definition of (x,y) tT ). We assume that / and 



g are of class C 1 and satisfy 

(12.119) /(0,0) = 0, g(0,0) = 0. 

Let us assume that there exists a feedback u : R n — > K m of class C 1 such that 

(12.120) e R™ is globally asymptotically stable for x = f(x,u(x)). 
Let V : MP -»Kbe a smooth Lyapunov function for x = /(x, u(x)): 

(12.121) i lim V(x) = +oo, 



(12.122) 
(12.123) 



lim V(x) 

\x\ — >-{-oo 

V(x) >y(0),Va;eR™\{0}, 
VV(x) ■ f(x, u(x)) < 0, Vcc e R n \ {0}. 



:;:is 
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Let (x, y) G R n x 



Note that, by ( |12.120| 1, 
(12.124) 



Let us consider the following Cauchy problem: 

X = f(X,u(X)),X(0)= Xl 
Y = g(X,u(X)),Y(0) = y. 

X(t) ^Oast^ +00. 



If the convergence in (12.1241 is fast enough (for example exponential), Y{t) con- 
verges as t — > +00. Let us assume that this is indeed the case and let 

(12.125) 

Let W : W l+ P - 



ip{x,y) := lim Y(t). 

t — >+oo 



1 be defined by 
(12.126) 

Note that 

(12.127) W((x, y) tv ) > W(0), V(«, y) G K" x K p such that (a;, y) / (0, 0). 



W((x,y)^) := K(cc) + \\ V {x lV )\\ W(x,y) G K" x 



Moreover, by (12.1231, £ G [0, +00) t— * V(X(t)) G K is non-increasing and in fact 
decreasing if X(0) ^ 0. Furthermore, it follows directly from the definition of if 
that 

(p(X(t),Y(t)) does not depend on t G [0, +00). 

Hence W can be expected to be a control Lyapunov function for our control system 
(12.118) and taking u = u + v with v, which could be small but well chosen, one 
can expect to stabilize the control system (12.1181. 

Let us show on a very simple example how this method works. We consider 
the control system 



(12.128) x = u 7 y = x, 

where the state is (x,y) tT G K 2 , (x, y) £lxl, and the control is u G 1 
just define u : K — > M. by 

u(x) = —x, \/x G K. 

: K — > K, let us, for example, take 
1 



Let us 



Then one has (12.1201. Concerning V 
(12.129) 



V(x) = -x 2 7 Vcc G K. 
One has, with the above notations, 
(12.130) X(t) = e'*x, Y(t) = (1 - e~*)x + y, Vt G 



From (12.125) and (12.1301, one gets 



(12.131) 



(p{x, y) = x + y, V(x, y) eRx 



From (|12_126j), ( |12.129[ ) and ( |12.131| , one has 

1 



(12.132) 



1 



W((x, V r) = tx 2 + -(x + yf. 



Note that, as seen above (see (12.127)), 

(12.133) W((x, y) tr ) > W(0), V(x, y) eRxR such that (x, y) / (0, 0). 
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Moreover, 
(12.134) 



lim W((x, V r) 
\ x \+\y\— >+°° 



Let us now compute the time derivative W of W along the trajectory of 

x = u{x) + v, y = x. 

One gets 

W = -x 2 + v{2x + y). 
Hence it is tempting to take 

v((x, 2/) tr ) := -(2s + y), V(x, rfelxl. 
With such a u, 



(12.135) 



T¥ 



x 2 - (2a; + yf < V(x, j/)e(lxl)\ {(0, 0)}. 
From (112.133b, dl2.134b and (112.135b, it follows that G R 2 is globally asymptoti- 



cally stable for the closed-loop system 

x = u(x) + v((x, y) tr ), y = x. 

One of the numerous interests of forwarding is to allow us to construct, under 
suitable assumptions, stabilizing feedback, which can be quite small. This has been 
used for example in [92, 129| to perform large amplitude orbit transfer of a satellite 
in a central gravitational field by means of an electric propulsion. (Let us recall 
that electric propulsion is characterized by a low-thrust acceleration level but a high 



specific impulse.) See also Section 12.2.1 if one does not care about the position at 



time t of the satellite on the desired final Keplerian elliptic orbit. 

Let us explain how this can be done on our simple control system (12.128). Let 
5 > 0. Let a G C°(R; R) be defined by 



(12.136) 
(12.137) 
(12.138) 

We take 

(12.139) 



aix) = x, \/x s [—<5, 5], 

<j{x) = 5, \/x e [6, +00), 

<j(x) = —5, Vie e ( — 00, —6}. 



Then u is globally Lipschitz and one has (12.120). Concerning V : 



keep the V defined in (12.1291. Straightforward computations lead to the following 
expressions for X(t): 



X(t) 



for t ^ and x G [—6, 5], 



X(t) =x-5t for te [0, {x - 5)/S\ and x E [6, +00), 

X(t) = 5e- t+((x - &),&) for t G [(x - S)/S, +00) and x G [5, +00), 

X(t) = x + St for t G [0,-{x + S)/S] and x G (-00, -<$], 

X(t) = -5e- t -^ x+s)/&) for te [-{x + S)/6, +00) and x G (-00, -6}. 



:;in 
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Using these expressions of X(t), one can compute Y(t) and one finally arrives at 
the following expressions for <p(x,y): 

ip(x, y) = x + y , Vz e [-6, 6] , Vy G R, 



tp(x,y) = 6 + 

p{x,y) = -s- 



26 
: 2 -6 2 



26 



+ y, Vx G [<5,+oo), VyGl, 
+ y,ViG (-oo,-J], Vyel 



Note that tp is of class C . One now gets, still with the above notations, 

W = -x 2 + v{2x + y), Vi€ [-6,6], \fy el, 

„2 p> 



W = -x5 + v% [26 + y + ^— — 
6 \ 2d 



W = x<5 



.r 



u- 



-2<5 + y 



:r 



2r> 



, Vi€ [<J,+oo), Vi/Gl, 
Va; G (-co,-5], Vj/eR. 



Let us point out that ( |12.133[ ) and ( |l2.134[ ) still hold. We define v : R 2 -> 1 

(12.140) v({x,y) tr ) = -cr(2x + y), Vx G [-5,(5], Vy G R, 

(12.141) v((x,yf) = -a (j (26 + y + ^f-J) > ^ x e [5, +00), Vj/ G 

(12.142) «((*, y) tr ) = a (| (-26 + y - X ^f- 



by 



, Vx G (—00, — 6], \/y G 



Then v is locally Lipschitz, vanishes at G K 2 and 

(12.143) W((x, yf) < 0, V(x, y)e(RxR)\ {(0, 0)}. 



From ( |12.133| , ( |12.134| and ( |12.143[ ), it follows that (0,0) G R 2 is globally asymp- 
totically stable for the closed-loop system 

x = w((x,y) tr ), y = x, 

where the feedback law u : R 2 — » K is defined by 

(12.144) u((x, j/) tr ) := u(x) + v((x, y) u ), V(x, y) G K x E. 



From ( |12.136D to ( |12.144| , 

| M ((x,y) tr )|<2«5, V(x,y)GKxK. 

Hence, using the forwarding technique, we succeeded to globally asymptotically 
stabilize G I 2 for the control system (12.1281 by means of feedback laws with 
L°°-norm as small as we want (but not 0). 



12.7. Transverse functions 

This section is borrowed from the paper |365] by Pascal Morin and Claude 
Samson. It gives a new simple and powerful tool to construct explicit feedback 
laws which almost lead to asymptotic stabilization. This method concerns, at least 
for the moment, control affine systems without drift, 



(12.145) 



XI U ifo 



( = 1 
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where the state is x = (x\, x 2 , • ■ ■ , x n ) tr G 0, u = (ui, u 2 , ■ ■ ■ , u m ) tr G W 11 . The 
set £1 is an open subset of K n containing 0, the vector fields /j, i G {1,2,..., m}, 
are assumed to be of class C°° on f2, and one assumes that m < n. One has the 
following theorem, due to Pascal Morin and Claude Samson. 

Theorem 12.27 f [365l Theorem 1]). Let T := R/2ttZ &e tfje one- dimensional 



torus. Let us assume that the control system (12.145) satisfies the Lie algebra rank 
condition at the equilibrium (x e ,u e ) := (0,0) G l"xl™ (see Definition 3.16 on page 



134). Then there exists an integer n ^ n such that, for every open neighborhood 
!lc!!o/0eR", there exists a function F G C°°{T n ' m ; 0) such that 

(12.146) Span {h(F(6)), f 2 (F(9)), ..., f m (F(6))} + Lm F'(0) = R n , V0 G T fi -"\ 



For the proof, we refer to [3651 Theorem 1]. Let us just give an example. We 
consider the control system 



(12.147) 



X\ = Ml, x 2 



where the state is (xi, x 2 , #3) tr G 



3, m = 2, Q 



-- U 2 , X 3 = UiX 2 , 

and the control is u 

tr 



(ui,u 2 ) tr G R 2 . So 



and, for every x = (xi, x 2 , X3) tr G 



(12.148) 



fM 



1\ 










, f 2 {x) ■= 


1 


x 2 




\o 



Note that, Vr; G R \ {0}, 



uifi(x) + u 2 f 2 (x) ^ (0, 0, ry) tr , \/x = {xi,x 2 , #3)* 



V(ui,u 2 ) 



Hence, by the Brockett Theorem 1 1 1 . 1 1 on page 289 the control system ( 12.147 1 can- 
not be asymptotically stabilized by means of continuous (even dynamic) stationary 
feedback laws. We have, for every x = (xi,x 2 ,X3) tT G K 3 , 



(12.149) 



[/i,/a](x) 




From (12.148) and (12.1491, one sees that the control system (12.1471 satisfies the 
Lie algebra rank condition at every equilibrium point (x,0) G Pxlr. Let us take 
n := 3. Hence n - 3 = 1. Let e > 0. We define F G C°°(T;R 3 ) by 



(12.150) 



F(6) 



£Sin(0) 
e cos(8) 

=■2 

=-sin(20), 



V0GT. 



Let Cl C M be an open neighborhood of G I 
image of F is included in Cl. Let H : T — > .Ms^f 



If e > is small enough, the 
be defined by 



H(9):=(h(F(6))J 2 (F(0)),-F'(0)). 



One has 



H{9) 



ecos(6>) 



— ecos{6) 
esin(0) 

^cos(20), 
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Hence 



det H{9) 



^0, 



showing that (12.146) holds 



Let us now explain how such functions F can be used to construct interesting 



feedback laws. For simplicity we explain it on the control system (12.147) with the 
map F defined by ( |12.150| . (Note that F depends on e > 0.) Let y : I 3 x T -> R 3 
be defined by 

fyx\ ( xx-F x {e) 

(12.151) y.= \y 2 := x 2 - F 2 (9) 

W \x 3 -F 3 (6)-F 1 (9)(x 2 -F 2 (6)) / 

Straightforward computations lead to 



(12.152) 
with 

(12.153) 

Note that 



y = C(y,9)H(9)(u 1 ,u 2 ,9) t 



N 



C(y,6):-- 





1 o] 1 Vy = (yi,y 2 ,y 3 ) tr eR 3 , Wg 

-F^e) i, 



det C{y, 8) = 1, Vj/ € R 3 , V6» G T. 



Hence the 3x3 matrix C(y, 9) is invertible for every y G 
In fact, as one easily checks, 

1 (^ 



and for every 9 G T. 



(12.154) C^)- 1 







1 



,V2/=(2/i,y2,2/3) tr G 



V<9g 



-2/2 F!(6>) 1, 



Let us consider the following dynamical extension (see Definition 11.5 



on page 



292) of the control system ( |12.147 l 

(12.155) x\ = «i, x 2 

where the state is (x%, x 2 , x 3 , 9) tT ( 

us choose A > 0. We consider the following feedback law for the control system 

( |12.155[ ): 

(12.156) {u llU2l vf := -XH(8y 1 C(y,9)- l y. 



U 2 , X 3 = U\X 2j = V, 

R 4 and the control is (ui,u 2 ,v) tl: 



Let 



From (12.152) and (12.1561, we get 



(12.157) 



-Xy. 



Let us consider a solution t G [0,+oo) t— > (xi(t), x 2 (t), x 3 (t), 9(t)) of the closed- 
loop system (|12.155|-(|12.156| (with y defined by (|12.151|). From (|12.151|, (112.154 1 



(|12.155|), (|12.156[) and ( |12.157[ ), one gets that 
there exists 9^ G 

lim x(t) = F{9 00 ). 



(12.158) 
(12.159) 



such that lim 9(t) = 9 C 

t — >oo 



Note that (12.1501 and (12.1591 imply the existence of T > such that 
(12.160) {t^T)=^ {\x{t)\^2e). 
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Moreover, it is not hard to see that for every compact K C R , there exists T > 
such that ( |12.160[ ) holds fo r every s olution t G [0, +00) (-» {x\(t), X 2 (t), x 3 (t), 9(t)) tT 
of the closed-loop system ( |l2.155| -( |l2.156| ) such that (xi(0), x 2 (0), x 3 (0), 6>(0)) tr G 
X. Since £ > is arbitrary, one gets what is usually called global "practical" 
asymptotic stabilizability 

Let us go back to the definition of y given in (12.151). Let us first point out 
that, if one takes, instead of (12.151 ), 

(12.161) y:=x-F(9), 



(which could sound more natural), one gets, instead of (12.1521, 

(12.162) 

with 



V — Y(xi,x 2 ,x 3 ,0,ui,U2,v), 



(12.163) 



Y(xi,X2,x 3 ,9,ui,U2,v) := 



u\ — ev cos(9) 
u 2 + svsm(9) 

u\x 2 — —vcos(29) 



But now we can no longer get (12.1571, no matter what we choose for the feedback 
(ill, u 2 , w) tr . Indeed, if we denote by Y 3 the last component of Y, then 

y 3 (xi, 0, x 3 , 7r/4, mi, u 2 , v) = 0, V(xi, x 3 , m,u 2 ,v) G K 5 . 



Hence, the choice of y is a key point in this method. The choice given by (12.151 ) 
is dictated by the Lie group structure of the control system ( 12.1471. Let us denote 
by * the following product in R 3 : 



(12.164) 



for every a = (01,02,03) 
checks that the C°°-manifold 





and for every b = (bi,b 2 ,b 3 ) t,: G K 3 . One easily 
equipped with * is a Lie group (for a definition 

of a Lie group, see, for example, 2, 4.1.1 Definition, page 253]). This can also be 

proved by pointing out that 






Oi 


G3\ 


/I 


ai + 61 


»3 + h + a 2 bi 





1 


a 2 = 


= ° 


1 


a 2 + b 2 








1/ 


\o 





1 



showing that (R 3 , *) is the group of upper triangular 3x3 real matrices with 1 on 
the diagonal. Note that the identity element of this Lie group is G R 3 and that 
the inverse a -1 of a = (ai, a 2 , a 3 ) tr is (— a%, —a 2l —03 + aia2) tr . 
For a G R 3 , let l a : R 3 -> R 3 be defined by 



la(b) 

We recall that a vector field X G C° 

oGR 3 , 



a*b,Vbe R 3 . 

R 3 ; R 3 ) is said to be left invariant if, for every 



((l a y{b))X{b) = X{a*b),\/beR :i ; 
see, for example, [2] page 254]. In other words, X is preserved by left translations. 
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Let us check that the vector field /i is left invariant. For a = (01, a 2 , as) tr G 



and for b = 


= (.b u b 2l b 3 ) tr eR 3 , one has 




/ Cl \ 


(12.165) 


((l a )'(b))c = c 2 , Vc = (ci, c 2 , c 3 ) tr € R 3 




\c 3 + a 2 ci/ 


Hence 


((J«)'(&))/i(&) = (1,0, 6 2 + a 2 ) tr = /!(o * 6), 



which shows that f\ is left invariant. One similarly checks that the vector field f 2 
is also left invariant. 

Note that the definition of y given by (12.151 ) can now be rewritten as 

(12.166) y :=x*F{ey 1 . 

Let us now show why the fact that the vector fields /1 and f 2 are left invariant is 
crucial to avoid the problem that we faced when we have defined y by ( 12.161 ). For 
3 — > R 3 (the right translation by a) be defined by 

r a (b) = 6* a, V6G K 3 . 



a G 



let r„ 



From (12.166), one has 
(12.167) 



y*F(0). 



Differentiating (12.1671 with respect to time, one gets, using (12.155), 
(12.168) ui/id, * F(8)) + u 2 f 2 (y * F(0)) = r' m (y)y + l' y (F(0))F'(6)v. 

Since f\ and / 2 are left invariant, 



(12.169) 



Mv * f(8)) = i'JF(9))My), My * no)) = i'(F(e))Mv)- 



From ( |12.168[ ) and ( |12.169| , one gets 



(12.170) 

or, equivalently, 

(12.171) 



y 



(ri, (e) (y))- 1 a;F(^))ff(0)( Ul , U2 , U ) tr , 



{u u u 2lV r = H{ey\i' y F{e))- l r' t 



' F (0)(y)y- 

Equality (12.171) shows that y can be chosen arbitrarily. Note that 

/l 0^ 



1 







0> 



l' v (F(8)) 



1 

v?/2 1, 



F(0) 



(y) 



1 
v o F 1 (e) i, 



which, together with (12.1541, lead to 
(12.172) (l' v (F(e)))- l r' F{e) (y) 




1 N 
1 
F 1 (jS) 1. 



C(y,6)-\ 



Hence, if we take, as above, y 
(112. 1721). 



-Ay, one recovers (12.1561 from (12.1711 and 



This method to construct dynamic feedback laws which lead to global practical 
stability works for every driftless control affine system x = J^j=i u ifi( x ) on a Lie 
group provided that the vector fields /j's are left invariant and that the control 
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system satisfies the Lie algebra rank condition at (e, 0) 6 I 3 x K 2 , where e is the 
identity element of the Lie group; see [366 , Theorem 1, page 1499 and Proposition 1, 
page 1500]. 

This method can also be used in order to (see [366] ) 

1. follow curves t <— > x(t) which could even not be such that t \— ► (x(t),u(t)) 
is a trajectory of the control system for a suitable 1 1— > u(t), 

2. get practical local stabilization even if the manifold is not a Lie group or the 
vector fields are not left invariant but have some homogeneity properties. 



CHAPTER 13 



Applications to some partial differential equations 



The goal of this chapter is to show that some methods presented in the previ- 
ous chapters can also be useful for the stabilization of linear or nonlinear partial 
differential control equations. We present four applications: 

1. rapid exponential stabilization by means of Gramians for linear time- rever- 



sible partial differential equations (Section 13.1 1 



stabilization of a rotating body-beam without damping (Section 13.2) 



stabilization of the Euler equations of incompressible fluids (Section 13.31 



stabilization of hyperbolic systems (Section 13.4) 



13.1. Gramian and rapid exponential stabilization 

In this section we explain how to use for infinite-dimensional linear control 



systems the Gramian approach for stabilization presented in Section 10.3 in the 
framework of finite-dimensional linear control systems. The Gramian approach for 
infinite-dimensional linear control systems is due to 

- Marshall Slemrod |450] for the case of bounded control operators (i.e., the 



with the notations of Section 2.3) 



case where the operator B on page 52 is continuous from U into H C D(A*)' 



Vilmos Komornik 278J for the case of unbounded control operators. 



For the extension of the Bass method (see Proposition 10.17 
on page 



lary 10.18 



on page 



286 and Corol- 



286 I to the case of infinite-dimensional linear control systems, 



we refer to Jose Urquiza [490]. 

We use the notations of Section [2.3| on abstract linear control systems. However, 
we need to assume that the strongly continuous semigroup S(t), t G [0,+oo), of 
continuous linear operators is in fact a strongly continuous group S(t), t G R, of 
continuous linear operators. 

Therefore, let H and U be two real (for simplification of notation) Hilbert 
spaces and let S(t), t G K, be a strongly continuous group of continuous linear 

on page 



operators on H (see Definition A. 12 



376 and Definition A. 13 



on page 

Let A be the infinitesimal generator of the strongly continuous group S(t), t G 

on page 



3761 



of 



continuous linear operators (see Definition A. 14 



3761. Then S(t)*, te 



is a strongly continuous group of continuous linear operators and the infinitesimal 
generator of this group is the adjoint A* of A (see Theorem A. 15 on page|376|). The 
domain D(A*) is equipped with the usual graph norm 
operator A*: 



\D(A* 



on page 3 
of the unbounded 



IzW^a*) := \\z\\ H + \\A*z\\ Hl Vz e D(A*). 
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Let D(A*Y be the dual of D(A*) with the pivot space H. Let B € £{U,D(A* 



We also assume the following regularity property (see (2.199 1): 



(13.1) Vt>0,3C t >0 such that f \\B* S{t)* z\\ 2 v dt < C T \\z\\ 2 H , Vz G D(A*). 

Jo 

The control system we consider here is 

(13.2) y = Ay + Bu, t E [0,T], 

where, at time t, the control is u(t) G U and the state is y(t) G H . For the definition 
of the solution to the Cauchy problem 

y = Ay + Bu, y(0) = y°, 

with given y° G H and given u G L 2 (0, T), we refer to Definition 



2.36 



on page 



:>:] 



For the existence and uniqueness of the solution to this Cauchy problem, we refer 
to Theorem |2.37| on page [53] 

Let T > 0. Let us recall (see Theorem 



2.42 



system is exactly controllable on [0, T] (see Definition 2.38 



on page|56| that the linear control 
on page 



55 I if and only 



if there exists c > such that the following observability inequality holds: 
r-T 

|2 



(13.3) 



\B*S{t)*z\\ijdt > cWzYh, Mz G D{A* 



o 



Throughout this whole section we assume that the linear control system y = Ay - 



Bu is controllable on [0,T]. Hence (13.31 holds for some c > 



Let A > 0. Our goal is to construct a feedback law K : y i— > Ky such that the 
closed-loop system y = (A + BK)y is well-posed (in a sense to be precise) and is 
such that, for some M > 0, every (maximal) solution of y = (A + BK)y defined at 
time satisfies 

\y(t)\\ H s: Me- M \\y(0)\\ Hl \ft G [0,+oo). 



(13.4) 
Let 




(13.5) 




Let h 


[o,r A ]-[o, 


(13.6) 


h(t) 



Tx 



1 
2A' 



-oo) be defined by 

e -2Xt 

2Ae" 2AT (T A - t) 
Let Q\ be the continuous symmetric bilinear form on D{A*) defined by 



if < t < T, 
HT^t^Tx. 



(13.7) 



\{y,z) 



h(t)(B*S(-tyy,B*S(-t)*z)dt, V(y,z) G D(A*) 2 



Using (13.1 1 and the fact that 

s(-ty = s(t x - tys(-T x y, vt g [o,t a ], 

one gets the existence of M\ > such that 

(13.8) \Q\(v,z)\ ^ M x \\y\\ H \\z\\„, M{y,z) G D(A*j 



Inequality (13.81 and the density of D(A*) allow us to extend in a unique way Q\ 
to a continuous symmetric quadratic form on H . We still denote this extension by 
Q\. By the Riesz representation theorem, there exists C\ G C(H;H) such that 

(13.9) Qx(y, z) = (y, C x z), V(y, z) G H 2 . 
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Note that 

(13.10) 

(13.11) 



s(-ty = s(t - tys(-T)*, \it e [o,t x ], 

S(-T)*S(T)*y = y,Vy£H. 



From (13.31, (13.6), (13.71, (13.101 and (13.11), one gets 



(13.12) Q x (y,y) > ce~™ ||5(-T)*j/||^ > ce~™ \\S(T)*\U 'M, Vy e H 



By the Lax-Milgram theorem, (13.91 and (13.121, C\ € C(H;H) is invertible in 
C(H;H). 

We are now in a position to define our stabilizing feedback. Let 

K x : C X (D(A*)) -» £/ 

be defined by 

(13.13) X A y := -B*C^y, Vy € C A (£>(^*)). 

One then has the following theorem, due to Vilmos Komornik [278 . 

Theorem 13.1. The operator A + BK\ is the restriction of an infinitesimal 
generator of a strongly continuous semigroup of continuous linear operators S(t), 
t £ [0, +oo), on H. Moreover, there exists M > such that 

\\S(t)y \\ H ^ Me- xt \\y°\\ H , Vt £ [0,+oo), \/y° e H. 

As stated, the meaning of this theorem is unclear since we have not defined 
the operator A + BK\ (and in particular its domain of definition)! This definition 
is rather involved and far beyond the scope of this book. It relies on a study 
of algebraic Riccati equations made by Franco Flandoli in |171j . See also |172j 
by Franco Flandoli, Irena Lasiecka and Roberto Triggiani, and [484] by Roberto 
Triggiani. 

We do not give the full details of the proof of Theorem |13.1| Let us simply give 
a proof of this theorem in the case of finite dimensional control systems in order 



to see the interest of the weight f\ (see (13.6)), a choice due to Frederic Bourquin 
(see |278| Note added in proof, page 1611] and [279, page 23]). Note that, if one 
simply takes T\ = T and 

(13.14) / A (i):=e- 2At ifO<i<T, 

one recovers what we have done in Section |10.3| see in particular Theorem |10.16| 



on page 



283 and (10.561. However, our proof of Theorem 10.16 



on the LaSalle invariance principle; see page 284 see also [450 . With the weight 
function f\ defined by (13.6), one does not need to use this principle. We readily 



on page 



283 relies 



get an explicit strict Lyapunov function. This is especially interesting in infinite 
dimension and/or if one wants to deal with nonlinear control systems which are 
small perturbations of our linear control system. 

So we assume that H and U are of finite dimension. Let y : K — > H be a 
(maximal) solution of 

BK x )y. 



(13.15) 


y=(A 


Let V : H - 


-> [0, +oo) be defined by 


(13.16) 


V{z) := z tr 



C7 l z, Vz e H. 
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By (13.81, (13.12) and (13.161, 



(13 


.17) 


^IWIir 


^ 


V(z)^ 


c- l e 2XT \\S(T) 


Let 


v :R^ 


K be denned 


by 






(13 


.18) 






v(t) := 


V(y(t)), Vt e 



\\S(Ty\\l iH . H) \\z\\ 2 H7 VzeH. 



From ( |13.13| , ( |13.15| , ( |13.16| and ( |13.18[ ), we get 

(13.19) v = -\B^C^y\ 2 + v*A*C?y + y tr C^Ay - y^C^BB^C^y. 

For two symmetric matrices Ai and A2 in C(H;H) 7 one says that Ai ^ A2 if 
z tr Aiz ^ z tr A 2 z for every z £ H. From (13.61, we have 



(13.20) 



2A/ A (i)<-/ A (i),V£e[0,T A ]\{T}. 



From (13.7 1, (13.9), (13.201 and an integration by parts, we get 

fx{t)e 

rT x 



c\ 



- tA BB tT e~ tA dt 










1 
2A ./ 



1 

2A 



f' x (t)e- tA BB tr e 



tr -tA 1 ' 



dl 



(BB tv - AC X - C x A tT ) 



Hence 



AC X + C x A tv - BB tv < -2AC A , 



from which we readily get 
(13.21) r, ~ 1 



C^A 



A tr C^ - C^BB^C^ 1 < 



-2XC^. 



From ( 13.19 I and ( 13.21 1, one gets 



v < -2Xv, 



which leads to 
(13.22) 



v{t) ^ e~ 2M v{0), Vi e [0,+oo). 
From (13.171 and (13.221, we finally obtain 

2At l|y(o)l^,vte[o,+oo). 



\*l|2 



\\y(t)\\H^c- l ^\\s(Ty\\ 



C(H;H 



M A e" 



This concludes the proof of Theorem |13.1| in the case of finite-dimensional control 
systems. ■ 

Let us end this section by mentioning that this method to construct feedback 
laws leading to rapid stabilization has been implemented and tested by various 
authors, for example by: 

- Frederic Bourquin in [66j for the wave equation with Dirichlet boundary 
condition. This paper proposes an approximation scheme of spectral type, 
such that the discrete controlled solutions have an energy which decays 
exponentially fast with the same decay rate as in the continuous case. 

- Frederic Bourquin, Michel Joly, Manuel Collet and Louis Ratier in |67j . 
This paper deals with the stabilization of flexible structures. It compares 
various methods for getting rapid exponential stabilization and it shows 
practical experiments. 
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Jean-Severin Briffaut in his Ph.D. thesis |72j under the supervision of 
Frederic Bourquin and Roland Glowinski. It is numerically observed and 
heuristically justified in this thesis that the exponential decay rate is two 



times larger than the one given in Theorem 13.1 at least if A is self-adjoint 
and Q\ is defined by 



Qx(y, 



-2Xt 



(B*S(-t)*y,B*S(-t)*z)dt, V(y,z) € D(A* 



compare with (13.7) 



This is confirmed theoretically by Jose Urquiza in 
page 286 Note that, with this new 
BK\ is now simpler. This is due to the fact 



[490] ; see also Proposition 10.17 
Qx, the definition of A 
that more explicit expressions are now available; see, in particular, (3.11) 
of [490], 
- Jose Urquiza in his Ph.D. thesis [489j under the supervision of Frederic 
Bourquin. 

13.2. Stabilization of a rotating body-beam without damping 

In this section we study the stabilization of a system, already considered by 
John Baillieul and Mark Levi in [25j . consisting of a disk with a beam attached to 
its center and perpendicular to the disk's plane. The beam is confined to another 
plane, which is perpendicular to the disk and rotates with the disk; see Figure [l] 
below. 

The dynamics of motion is (see |25j and [26] ) 



(13.23) 



(13.24) 



pytt(t,x) + EIy x 



c (t,x) + pBy t {t,x) 
= puj 2 {t)y{t,x), t e (0,+oo), x e (0,L), 



y(t, 0) = y x (t, 0) = y xx (t, L) = y xxx (t, L) = 0, t € (0, +oo), 



d 



(13.25) -\uj(t)(J d + pJ y 2 (t,x)dx) I = T(t), t e (0,+oo), 

where L is the length of the beam, p is the mass per unit length of the beam, 
EI is the flexural rigidity per unit length of the beam, u)(t) = 9{i) is the angular 
velocity of the disk at time t, Jd is the disk's moment of inertia, y(t, x) is the beam's 
displacement in the rotating plane at time t with respect to the spatial variable x, 
By t is the damping term and T(t) is the torque control variable applied to the 
disk at time t (see Figure nl). It is a control system where, at time t, the state is 
[y{t, •), yt(t, -),ui(t)) and the control is T(t). 
If there is no damping, B 



(13.26) 



f>ytt(t,x) + EIy x 



and therefore (13.23) reads 

(t,x) = puj 2 (t)y{t,x). 



The asymptotic behavior of the solutions of ( 13.23 l-( 13.24 )-( 13.25 I when there 
is no control (i.e., T = 0), but with a damping term (i.e., when B > 0), has 
been studied by John Baillieul and Mark Levi in |25| and by Anthony Bloch and 
Edriss Titi in [59:. Still when there is a damping term, Cheng-Zhong Xu and 
John Baillieul have shown in |505j that the feedback torque control law T = —vlu, 
where v is any positive constant, globally asymptotically stabilizes the equilibrium 
point (y,y t ,u>) = (0,0,0). It is easy to check that such feedback laws do not 
asymptotically stabilize the equilibrium point when there is no damping. 
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Figure 1. The body-beam structure 



In this section, we present a result obtained in |119j on the stabilization prob- 
lem when there is no damping. We shall see that the design tools presented in 
Section |12.5| will allow us to construct in this case a feedback torque control law 
which globally asymptotically stabilizes the origin. 

Of course, by suitable scaling arguments, we may assume that L = EI = p = 1 . 
Let 

H = {w= {u,v) tr ; u G H 2 {0, 1), v G L 2 (0, 1), u(0) = u x (0) = 0}. 
The space H with inner product 

-l 



((ui,vi) \{u 2 ,v 2 ) 



)H 



(ui xx u 2xx + viv 2 )dx 



is a Hilbert space. For w G H, we denote by ||w||# the norm of w and let 

£(w) = \\wf H . 
We consider the unbounded linear operator A : D(A) C H — > H defined by 



D(A) :- 



; ueH 4 {0,l) 1 veH 2 {0,l), 



m(0) = u x (0) = u xx (l) = u xxx {l) = v(0) = v x {0) = 



One easily checks that 



T>{A) is dense in H , 
A is a closed operator, 

A* = -A. 



Hence, from the Lumer-Phillips theorem (see Theorem A. 16 



on page 



377), A is the 



infinitesimal generator of a strongly continuous group S(t), t G M, of isometries on 
H. 
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(13.27) 



With this notation, our control system ( 13.24 )-( 13.25 l-( 13.26 I reads 

dw . 2 (0 s 

1- Aw = lu 2 [ 

dt \u, 



(13.28) 
with 

(13.29) 



dco 

~dl 



7, 



7 — 2io J uvdx 
Jd + f u 2 dx 



By (13.291, we may consider 7 as the control. In order to explain how we have con- 



structed our stabilizing feedback law, let us first consider, as in the usual backstep- 



ping method (see Section 12.5 above), equation (13.271 as a control system where 
w is the state and u> is the control. Then natural candidates for a control Lyapunov 
function and a stabilizing feedback law are, respectively, £ and u = °~*(f uvdx), 
where a* G C°(R,R) satisfies a* > on ( -00, 0) and a* = on [0,+oo). (This is 
the usual damping technique; see Section 12.2 ) One can prove (see |119( Appen- 
dix]) that such feedback laws always give weak asymptotic stabilization, i.e., one 
gets 



(13.30) 
instead of 
(13.31) 



w(i) — *■ weakly mH &st — > +00, 



w(t) — > in H as t — > +00. 



But it is not clear that such feedbacks give strong asymptotic stabilization. It 
is possible to prove that one gets such stabilization for the particular case where 
the feedback is 

(13.32) w := (max{0, -/ uvdx})^ . 



Unfortunately, ui defined by (13.32) is not of class C 1 and so one cannot use the 



proof of Theorem 12.24| on page 334] to get asymptotic stabilization for the control 
system ( 13.27 1-( 13.28 I which is obtained by adding an integrator to control system 



(13.271. The regularity of this u) is also not sufficient to apply the desingularization 



techniques introduced in [392 ; see Section 12.5.1 above. For these reasons, we use 
a different control Lyapunov function and a different feedback law to asymptotically 



stabilize control system (13.271 



For the control Lyapunov function, we take 

1 ' '- 1 

2 

where F G C 3 ([0, +00); [0,+oo)) satisfies 



J(w) 



£{w) - F(£(w)) / u z dx , Vw = (w,w) tr e H 



11 



(13.33) 



sup F(s) 

B>0 



< 



Ml 

2 ' 



where fii is the first eigenvalue of the unbounded linear operator (dr/dx ) on 
L 2 (0, 1) with domain 

Bom(d 4 /dx 4 ) = {/; / e 7/ 4 (0, 1) , /(0) = f x (0) = f xx (l) = f xxx (l) = 0}. 
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Note that this operator is self-adjoint (i.e., is equal to its adjoint) and has compact 
resolvent. Hence, by the definition of //i, 



(13.34) 



u xx dx ^ \i\ j u dx , \/w g H. 



From (13.331 and (13.341, 



(13.35) 



-£{w) < J(w) < -£{w) , Vui e ff. 



Computing the time-derivative J of J along the trajectories of (13.271, one gets 

(13.36) j = (Kuo 2 - F {£)) ( j uvdx 

where, for simplicity, we write £ for £(w) and where 

.1 
(13.37) 

Let us impose that 



K(= K{w)) := 1 - F'{£) / u 2 dx. 

o 



(13.38) 



(13.39) 



< F'{s)s <fn- F(s) , Vs e [0, +oo 

F(s 



3Ca > such that lim 



s— >0,s>0 s 



Ca. 



It is then natural to consider the feedback law for (13.27) vanishing at and 
such that, on H \ {0}, 



jf-i/2 (f{£) - a ( / uvdx 



(13.40) 

for some function a g (7 2 (R;K) satisfying 

(13.41) sct(s) >0,Vs€ R\{0}, 



(13.42) 



(13.43) 



3C5 > such that lim 



a(s) 



C 5 



s->0, s^O S 



a(s) < F(2^/Ji 1 s) , Vs > 0. 



Note that, using (13.341, one gets that, for every w = (u,v) £ H, 
-1 



1 f 
uvdx ^ -{yffl\ I u 2 dx 

2 Jo 



1 



(13.44) 



€ 



1 



2v/^I 



Mi Jo 
1 r-i 

2 J™ 1 / „,2, 

Jo 



1; dx) 



u Trr dx + v dx 



1 



2VMi 



£(«,) 



which, together with (13.38), (13.39) and (13.431, implies that 
(13.45) 



F(S(w)) - a ( / w«dx )>0,Vw6ff\ {0}. 



From ( |13.34| , ( |13.37| and ( |13.38[ ), one gets 

(13.46) K(w) > 1 - f ' (£H) /"' tt^di > 1 " F(gW) £H > , \fw e ff. 

Mi Jo Mi 
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From ( 13.45 I and ( 13.46 I, we get that u) is well defined by ( 13.40 ) and is of class C 
on H \ {0}. This regularity is sufficient to apply the desingularization technique of 
[392] (see Section 12.5.1 above). We note that (13.40) is equivalent to 

»1 



(13.47) 



uj 3 = ^{ w ) ■= K~ 3 ' 2 F(S(w)) 



uvdx 



and therefore, following [392 , one considers the following control Lyapunov func- 

1 



tion for control system ( 13.27 1-( 13.28): 



V(w,u>) = J+ / i (s - ip)da = J+ -uj - ipu + -ip 3 , 



tj}3 



where, for simplicity, we write J for J{w) and ip for ip(w). Then, by (13.351, 

(13.48) V(w,w) -» +oo as \\w\\ H + \u\ -> +oo, 

(13.49) V(w, to) > , V(w, w)gjETxl\ {(0, 0)}, 

(13.50) K(0,0)=0. 

Moreover, if one computes the time-derivative V of V along the trajectories of 



(13.27 1-( 


13.28), 


(13.51) 


V = - 


where 




(13.52) 




with 




(13.53) 




i> := 


3-0 5 
IK 



uvdx) a I / uvdx ) + (w — ifj 3 )[y(uj 2 + i(j 3 uj + ip 3 ) + D], 



D := — ip + K (u + i/i 3 ) / uvdx, 
Jo 



I uvdx] (lu 2 F"(£) u 2 dx + F'{£) 



2F'(£)u> 2 / uvdx - a' ( / uvdx 
3^ 

Hence it is natural to define the feedback law 7 by 
(13.54) 7(0,0) :=0 

and, for every (w,u) € (H x K) \ {(0,0)}, 



(v 2 — u 2 x + ui 2 u 2 )dx 



(13.55) 



j(w, u>) := — (w — ip 3 ) 



D 



W 2 +V' 3 W + '0 3 



Note that by Ql3.45| ), ([1_3.46| and ([137471 

(13.56) 



V'(w) >0,Vw£ -ff\{0}. 



Moreover, by ( |13.37[ ), ( |13.39| , ( |13.42[ ), ( |13.43| and ( |13.44[ ), there exists <5 > such 
that 



(13.57) 



ip(w) > 6£(w) 3/2 ,VweH such that £{w) < S. 



Using ( |13.37| , ( |13.46| , ([13_47j), (|13_52j), ( |13.53| , ( |13.55| , ([13_56j) and (|13_57j), one 
easily checks that 7 is Lipschitz on bounded sets of H x K. Therefore the Cauchy 
problem associated to ( 13.27 1-( 13.28 I has, for this feedback law 7 and an initial 
condition given at time 0, one and only one (maximal) solution defined on an open 
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interval containing 0. (The definition of a solution is the definition of a usual mild 
solution as given, for example, in [3811 Definition 1.1, Chapter 6, page 184]. It is 
quite similar to the one given in Definition |2.86| on page |96| For the existence and 
uniqueness of (maximal) solutions, we refer, for example, to 381, Theorem 1.4, 
Chapter 6, pages 185-186].) By ( pl^ ), ( pin] ), ( flT52"] ), ( flT54"l ) and ( [T3755| ), one 
has 



(13.58) V 



uvdx 



uvdx 



(lu - ip->) 2 (uj 2 + ipzoj + ipz) ^ 0, 



which, together with ( 13.48 1 and a classical property of maximal solutions (see, e.g. 



J381I Theorem 1.4, Chapter 6, pages 185-186]) shows that the (maximal) solutions 



of ( 13.27 1-( 13.28 1 defined at time to are defined on at least [£q,+oo). 



One has the following theorem. 



Theorem 13.2. The feedback law 7 defined by (13.54)-(13.55) globally strongly 
asymptotically stabilizes the equilibrium point (0,0) for the control system (13.21)- 
{13.2S\), i.e., 



(i) for every solution of {13.27] ), {13.28] ), {13.51$ and {13. 55]} 
(13.59) lim \\w(t)\\ H +\uj(t)\=0; 

t — >+oo 



(ii) for every e > 0, there exists rj > such that, for every solution of (13.27) 



( 13J8] , {13.54]} and {13.55]} , 

(|M0)||h + |c(0)| < rj) =» {\\w{t)\\ H + |w(t)| < e , \/t > 0). 

is given in [119] , Let us just mention that it is 



The proof of Theorem 
divided into two parts: 

(i) First one proves that the trajectories of ( 13.27 1-( 13.28) are precompact in 

H for £ > 0. 
(ii) Then one concludes by means of the LaSalle invariance principle. 

The main difficult point is to prove (i). More precisely, one needs to prove that 
the energy associated to the high frequency modes is uniformly small. In order to 
prove this uniform smallness a key point is that all these modes satisfy the same 
equation as w. Finally, an important ingredient is to get some estimates on L uvdx 
for any solution of ( 13.27 1-( 13.28), which allow us to prove the uniform smallness. 



13.3. Null asymptotic stabilizability of the 2-D Euler control system 

In this section we address a problem of stabilization of the Euler equations. 
In Section |6.2.1| we considered the problem of controllability of the Euler control 
system of an incompressible inviscid fluid in a bounded domain. In particular, we 
saw that, if the controls act on an arbitrarily small open subset of the boundary 
which meets every connected component of this boundary, then the Euler equation 
is exactly controllable. 

For linear control systems, the exact controllability implies in many cases the 
asymptotic stabilizability by means of feedback laws. As we saw in Theorem 10.1 on 



page |275| this is always the case in finite dimension. This also holds for important 
partial differential equations as shown by Marshall Slemrod in 450 1, Jacques-Louis 
Lions in [326J, Irena Lasiecka and Roberto Triggiani in |299 and Vilmos Komornik 
in |278j ; see also Section 13.1 
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However, as we saw in Section [ll.l| this is no longer true for nonlinear control 
systems, even of finite dimension. For example, the nonholonomic integrator 



(13.60) 



x\ = u\, x 2 = u 2 , x 3 = x\u 2 - X2U1, 



where the state is (x\, x 2 ,x 3 ) G K 3 and the control is (u\. 
locally controllable at the equilibrium (x e , u e ) := (0, 0) € I 
on page 



u 2 ) 
l 3 x 



' e R , is small-time 
i 2 (see Example 



135 or Example 6.3 I. However, as we have seen in Example 11.2 



(an example due to Roger Brockett [74 ), the control system (13.60) cannot be 



3.20 



on page 



289 



locally asymptotically stabilized by means of continuous stationary feedback laws. 



Note however that, by Theorem 11.14 on page 297 the driftless control affine system 



(|13.60| can be globally asymptotically stabilized by means of smooth periodic time- 
Let us also notice that, as 



varying feedback laws (see Example 11.16 



on page 



297) 



for the control system (13.601, the linearized control system of the Euler equation 



around the origin is not controllable, as we have seen on page |195| 

Therefore it is natural to ask what is the situation for the asymptotic stabiliz- 
ability of the origin for the 2-D Euler equation of an incompressible inviscid fluid in 
a bounded domain, when the controls act on an arbitrarily small open subset of the 
boundary which meets every connected component of this boundary. In this section 
we are going to prove that the null global asymptotic stabilizability by means of 
feedback laws holds if the domain is simply connected. 

Let fl be a nonempty bounded connected and simply connected subset of K 2 
of class C°° and let Tq be a nonempty open subset of the boundary <9f2 of f2. This 
set To is the location of the control. Let y be the velocity field of the inviscid fluid 
contained in O. We assume that the fluid is incompressible, so that 



(13.61) 



div y = 0. 



Since 57 is simply connected, y is completely characterized by w := curl y and 
y ■ n on 9fi, where n denotes the unit outward normal to 90. For the controllability 
problem, one does not really need to specify the control and the state; one considers 
the "Euler control system" as an under-determined system, by requiring y ■ n = 
on <9f2 \ To instead of y ■ n = on <9f2 which one requires for the uncontrolled usual 
Euler equation. For the stabilization problem, one needs to specify more precisely 
the control and the state. In this section, the state at time t is equal to w(t, •). For 
the control at time t, there are at least two natural possibilities: 

(a) The control is y(t, x) ■ n(x) on To and the time derivative dw/dt(t, x) of the 
vorticity at the points x of Vq where y(t,x) ■ n{x) < 0, i.e., at the points 
where the fluid enters into the domain S7. 

(b) The control is y(t, x) ■ n{x) on Tq and the vorticity lu at the points x of Tq 
where y(t,x) ■ n{x) < 0. 



Let us point out that, by ( 13.61 1, in both cases y ■ n has to satisfy J gii y ■ n 
this section, we study only case (a); for case (b), see |114| . 
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r + nr - 



Let us give stabilizing feedback laws. Let g G C°°(dCl) be such that 

(13.62) the support of g is included in To, 

(13.63) r^ := {g > 0} and Tq := {g < 0} are connected, 

(13.64) g/0, 

(13.65) 
(13.66) 

For every / G C°(f2), we denote 

|/| =Max{|/(i)|;ar€n}. 
Our stabilizing feedback laws are 

y-n = M\uj\ g on r , 

-M|w| wonr^if M ^0, 



3 = 0. 



.)<) 



dw 



where M > is large enough. 

With these feedback laws, a function w : 7 x f2 — > K 
is a solution of the closed-loop system £ if 

dw ° 

+ div (toy) = in 7 x £2, 



where 7 is a time interval, 



(13.67) 

(13.68) 

(13.69) 
(13.70) 

(13.71) 



dw 

~dt 



01 



div y = in I x £1, 

o 

curl y = w in / x f2, 
y(t) -n = M\u>(t)\ g on 90, Vt G I, 

= -M |w(*) | ^ on {t G 7; w(t) /0}xf o 



Here, I denotes the interior of I C R and for te/, w(t) : f2 — > M and y(t) : il — > K 2 
are defined by requiring u>(t)(x) = uj(t,x) and y(t)(x) = y(t,x),Vx G fi . More 
precisely, the definition of a solution of the system E follows. 

Definition 13.3. Let I be an interval. A function lo : I — > C (O) is a solution 
of the system S if 

(i) w G C°(7; C°(n_)_)(^ C°(J x Si)), 
(ii) for y G C (7 x O; R 2 ) defined by requiring 



of distributions and (13.701, one has (13.67 



13.68) and (13.691 in the sense 



7 ) in the sense of distributions, 

o 

(iii) in the sense of distributions on the open manifold {t G 7; u>(t) ^ 0} x Tn, 
one has dta/dt = —M |w(i)L w. 

Our first theorem says that, for M large enough, the Cauchy problem for the 
system X has at least one solution defined on [0, +oo) for every initial data in 
C (O). More precisely one has: 

Theorem 13.4 ( |114| ). There exists M > such that, for every M ^ Mo, 
the following two properties hold: 

(i) For every coq G C°(tt), there exists a solution of the system S defined on 
[0, +00) such that u>(0) = u)q. 
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(ii) Every maximal solution of system S defined at time is defined on [0, +oo) 
(at least). 

Remark 13.5. a. In this theorem, property (i) is in fact implied by property 
(ii) and Zorn's lemma. We state (i) in order to emphasize the existence of a solution 
to the Cauchy problem for the system S. 

b. We do not know if the solution to the Cauchy problem is unique for positive 
time. (For negative time, one does not have uniqueness since there are solutions 
uj of system S defined on [0, +00) such that w(0) 7^ and uj(T) = for some 
T € (0,+oo) large enough.) 

However, let us emphasize that, already for control systems in finite dimension, 



we have considered feedback laws which are merely continuous (see Chapter 11 and 



Chapter 12). With these feedback laws, the Cauchy problem for the closed-loop 
system may have many solutions. It turns out that this lack of uniqueness is not a 
real problem. Indeed, in finite dimension at least, if a point is asymptotically stable 
for a continuous vector field, then there exists, as in the case of regular vector fields, 
a (smooth) strict Lyapunov function. This result is due to Jaroslav Kurzweil [289] . 
It is tempting to conjecture that a similar result holds in infinite dimension 
under reasonable assumptions. The existence of this Lyapunov function ensures 
some robustness to perturbations. It is precisely this robustness which makes the 
interest of feedback laws compared to open-loop controls. We will see that, for our 
feedback laws, there also exists a strict Lyapunov function (see Proposition 13.9 on 



the next page) and therefore our feedback laws provide some kind of robustness. 

Our next theorem shows that, at least for M large enough, our feedback laws 
globally and strongly asymptotically stabilize the origin in C (O) for the system S. 

Theorem 13.6. There exists a positive constant M\ ^ M such that, for every 
e £ (0, 1], every M Js M\/e and every maximal solution u> of system S defined at 
time 0, 

(13.72) |w(*)| < Mm {|w(0)| , |} , Vt > 0. 

Remark 13.7. Due to the term |w(t)| appearing in (13.701 and in (13.71 1, our 
feedback laws do not depend only on the value of u on Tq. Let us point out that 
there is no asymptotically stabilizing feedback law depending only on the value of 
uj on To such that the origin is asymptotically stable for the closed-loop system. In 
fact, given a nonempty open subset f^o of fl, there is no stabilizing feedback law 
which does not depend on the values of u on fio • This phenomenon is due to the 
existence of "phantom vortices" : there are smooth stationary solutions y : fi — > K 2 
of the 2-D Euler equations such that Support y C fio and uj := curl y ^ 0; see, e.g., 
|341j . Then ui(t) = uj is a solution of the closed-loop system if the feedback law 
does not depend on the values of u> on 57q> and vanishes for lu = 0. 



Remark 13.8. Let us emphasize that (13.72) implies that 

(13.73) |w(t)| <e,Vt>l, 

for every maximal solution uj of system £ defined at time (whatever oj(0) is). It 
would be interesting to know if one could have a similar result for the 2-D Navier- 
Stokes equations of viscous incompressible flows, that is, if, given e > 0, there 



exists a feedback law such that (13.731 holds for every solution of the closed-loop 
Navier-Stokes system. 
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Note that y = on Tq is a feedback which leads to asymptotic stabilization of 
the null solution of the Navier-Stokes control system. However, this feedback does 
not have the required property. One may ask a similar question for the Burgers 
control system; for the null asymptotic stabilization of this control system, see the 
paper [287j by Miroslav Krstic and the references therein. For local stabilization 
of the Navier-Stokes equations, let us mention in particular [29 by Viorel Barbu, 
|31j by Viorel Barbu and Roberto Triggiani, [30 by Viorel Barbu, Irena Lasiecka 
and Roberto Triggiani, [183] by Andrei Fursikov, [399] by Jean-Pierre Raymond 
and 492 . These papers use in a strong way the viscous term vAy (see equation 



(6.23 1) ; the Euler part (y- V)j/ is essentially treated as a perturbation term which is 



more an annoying term than a useful term. Note that Theorem |13.4| and Theorem 
|13.6| seem to show that the Euler term might be useful in some situations, even for 
the Navier-Stokes control system. 



Sketch of the proof of Theorem |13.6[ (The detailed proofs of Theorem 13.4 



and of Theorem 13.6 are given in |114j .) Let us just mention that the proof relies 

; °(fi)^[0,4 

|wexp(-6>)| 



on an explicit Lyapunov function V : C°(Q) — > [0, +oo). This function V is defined 
by 



(13.74) 


V(w) = 


where 6 G C°°(f2) satisfies 




(13.75) 


AO 


(13.76) 


08 
dn 



■- in n, 
g on d£l. 

" is an 



(Let us point out that the existence of 9 follows from (13.66).) Theorem 13.6 
easy consequence of the following proposition. 

Proposition 13.9. There exist M 2 > M and fi > such that, for every 
M ^ Mi and every solution uj : [0,+oo) — > C°(f2) of system E, one has, for every 

te [o,+oo) 7 

(13.77) [-oo, 0] 3 V(t) := -j^V(w(t)) < -^MV 2 (u;(t)), 

where d/dt + V{iu(t)) := lim £ ^ + (V(u(t + e)) - V{w{t)))/e. ■ 



Let us end this section by some comments on the case where Q, is not simply 
connected. In this case, in order to define the state, one adds to u> the real numbers 
Ai, . . . , X g defined by 

\= [ yV-'-ri, 
Jo 

where, if one denotes by Co, C\ , . . . , C g the connected components of T, the functions 
Ti G C°°(U),i G {1, ... ,g] are defined by 

An = o , 

Ti = on dtt \ Ci , 
n = 1 on C iy 

and where V^Tj denotes Vr^ rotated by ir/2. One has the following open problem. 
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Open Problem 13.10. Assume that g Jj 1 and that Tq meets every connected 
component ofT. Does there always exist a feedback law such that £ C (Q) x M. 9 
is globally asymptotically stable for the closed-loop system? 

Recently Olivier Glass has got in [199, a positive answer to this open problem 
if one allows to add an integrator on the vorticity u> (in particular he has proved 
the global asymptotic stabilizability by means of dynamic feedback laws (see Defi- 
nition 



11.5 on page 292) 



Brockett's necessary condition [74j for the existence of asymptotically stabi- 
lizing feedback laws cannot be directly applied to our situation since our control 
system is of infinite dimension. However, it naturally leads to the following ques- 
tion. 

Question. Assume that Tq meets every connected component ofT. Let f € C°°(Cl). 
Do there exist y € C°°(fT;R 2 ) and p e C°°{Ti) such that 

(13.78) (y.V)y + Vp = / m U , 

(13.79) div y = in U , 

(13.80) y-n = on T \ T ? 

Let us point out that, by scaling arguments, one does not have to assume that / 
is "small" in this question. It turns out that the answer to this question is indeed 
positive. This has been proved in |115j if £1 is simply connected and by Olivier 
Glass in |197j for the general case. For many results on feedback in flow control, 
see the book pQ. 

13.4. A strict Lyapunov function for boundary control of hyperbolic 

systems of conservation laws 

This section is borrowed from |121j . It concerns some systems of conservation 
laws that are described by partial differential equations, with an independent time 
variable t G [0, +oo) and an independent space variable a; on a finite interval [0, L\. 
For such systems, the boundary control problem that we consider is the problem 
of designing control actions at the boundaries (i.e., at x = and x = L) in order 
to ensure that the smooth solution of the Cauchy problem converges to a desired 
steady-state. One can use an entropy of the system as a Lyapunov function (see 
|120j and |125| ). Unfortunately, this Lyapunov function has only a semi- negative 
definite time derivative (i.e., one has only V ^ 0). Since LaSalle's invariance 
principle seems to be difficult to apply (due to the problem of the precompactness of 
the trajectories), one cannot conclude easily the stability of the closed- loop control 
system. 

In this section, assuming that the system can be diagonalized with the Rie- 
mann invariants, we exhibit a strict Lyapunov function which is an extension of the 
entropy but whose time derivative can be made strictly negative definite by an ap- 
propriate choice of the boundary controls. We give a theorem which shows that the 
boundary control allows us to have the local convergence of the system trajectories 
towards a desired steady-state. Furthermore, the control can be implemented as a 
feedback of the state only measured at the boundaries. The control design method 
is illustrated with an hydraulic application: the regulation of the level and the flow 
in an horizontal reach of an open channel. 
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For the sake of simplicity, our presentation is restricted to 2 x 2 systems of 
conservation laws. From our analysis, it is however very clear that the approach can 
be directly extended to any system of conservation laws which can be diagonalized 
with Riemann invariants. It is in particular the case for networks channels where 
the flux on each arc is modeled by a system of two conservation laws (see, e.g., 
|210j by Martin Gugat, Giinter Leugering and Georg Schmidt, [214] by Jonathan 
de Halleux, Christophe Prieur and Georges Bastin, as well as [215!). 

13.4.1. Boundary control of hyperbolic systems of conservation laws: 
statement of the problem. Let fl be a nonempty connected open set in R 2 and 
let L > 0. We consider a system of two conservation laws of the general form 



(13.81) 






Y t + f(Y) x 


= 0, te 


[0. 


where 

1. 

2. 


Y = 

fe 


-- (2/1,2/2)' 

C 3 (fi;R' 


r : [0, +00) x [0, L] - 
'') is the flux density. 


ci 



We are concerned with the smooth solutions of the Cauchy problem associated to 



the system (13.811 over [0, +00) x [0,L] under an initial condition 

Y{0,x) = Y°{x),xE [0,L], 

and two boundary conditions of the form 

B o {Y{t,0),u o {t)) = 0,te [0,+oo), 
B L {Y{t,L),u L {t)) = 0, t G [0,+oo), 

with Bq, Bl, : Cl x R — > R. This is a control system where, at time t, the state is 
Y(t, ■) and the control is (u {i), u L (t)) tr G R 2 . 

For constant control actions Uo(t) = uq and ui,(t) = ul, a steady-state solution 
is a constant solution 

Y(t, x) = Y, Vt G [0,+oo), Vie [0,L], 



which satisfies ( 13.81 ) and the boundary conditions Bo(Y, Uo) = and Bl(Y , ul) = 
0. In other words, (Y ,uo,ul) is an equilibrium of our control system (see Defini- 
tion 



3.1 on page 125 I 



The boundary stabilization problem we are concerned with is the problem of 
finding localized feedback laws Y(t,0) -> u (Y(t,0)) and Y(t,L) -> u L (Y(t,L)) 
such that, for any smooth enough initial condition Y (x), the Cauchy problem for 



the system (13.811 has a unique smooth solution converging towards the desired 



given steady-state Y. 



In this section, we consider the special case where the system (13.81 ) is strictly 
hyperbolic, i.e., the Jacobian matrix f'(Y) has two real distinct eigenvalues for 
every Y £ CI. We also assume that the two eigenvalues of f'(Y) have opposite 
signs: \ 2 {Y) < < XijY), VF G Cl. 



The system ( 13.81[) can be "diagonalized", at least locally, using the Riemann 



invariants (see, e.g., [3051 pages 34-35] by Peter Lax). This means that, for every 
Y G Cl 7 there exist an open neighborhood Cl of Y and a change of coordinates 
£(Y) = (a(y), b(Y)) tr whose Jacobian matrix is denoted D(Y), 

D(Y)=e(Y), 
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and which diagonalizes f'(Y) in 0: 

(13.82) D(Y)f'(Y) = A{Y)D{Y),Y en, 

with 

A(y) = dia g (A 1 (y),A 2 (y)), 

where Ai (Y) , A2 (V) are the eigenvalues of f'(Y). As it is shown by Peter Lax 



in |305l pages 34-35], the first order partial differential equation (13.821 can be 
reduced to the integration of ordinary differential equations. Moreover, in many 
cases, these ordinary differential equations can be solved explicitly by using sep- 
aration of variables, homogeneity or symmetry properties (see, e.g., [443, pages 
146-147, page 152] for examples of computations of Riemann invariants). In the 



coordinates £ = (a, 6) tr , the system (13.811 can then be rewritten in the following 
(diagonal) characteristic form: 



(13.83) a t + c(a, b)a x = 0, b t — d{a, b)b x = 0, 

where c(a,b) = Ai(£) > and —d(a,b) = A 2 (£) < are the eigenvalues of f'(Y) 



expressed in the £ = (a, b) tr coordinates. Throughout Section 13.4 we assume that 
c and d are two functions of class C 2 on a neighborhood of (0, 0) € K 2 such that 

c(0,0) > 0, d(0,0) > 0. 

We observe that the quantity a t + c(a, b)a x (resp. b t — d(a, b)b x ) can be in fact 
viewed as the total time derivative da/dt (resp. db/dt) of the function a(t, x) (resp. 
b(t,x)) at a point (t,x) of the plane, along the curves having slopes 

— = c{a,b) (resp. — = -d(a,b)). 

These curves are called characteristic curves . Since da/dt = and db/dt = 
on the characteristic curves, it follows that a(t, x) and b(t, x) are constant along 
the characteristic curves. This explains why the characteristic solutions are called 
Riemann invariants. 

The change of coordinates £(Y) can be selected in such a way that £(Y") = 0. We 
assume that such a selection is made. Then the control problem can be restated as 
the problem of determining the control actions in such a way that the characteristic 
solutions converge towards the origin. 

Our goal in this section is to propose and analyze a control design method 
based on a strict Lyapunov function that is presented in the next section. 

13.4.2. A strict Lyapunov function for boundary control design. Let 



us consider first the linear approximation of the characteristic form (13.83) around 
the origin: 

(13.84) at + ca x = 0, b t - db x = 0, 

with c = c(0, 0) > and d = d(0, 0) > 0. 

With a view to the boundary control design, let us propose the following can- 
didate for a Lyapunov function: 

U(t):=U!(t) + U 2 (t), 



.mi 
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with 



Ui(t) 



a 2 (t,x)e-^/ 5 1 x dx, U 2 (t) 



B 

1 



b 2 (t,x)e +( -^^ x dx, 



where A, B and /! are positive constant coefficients. 

This type of Lyapunov function is related to the Lyapunov function used in 
Section 13.3 to stabilize the Euler equation (see (13.74) and |114j ). It has been 
introduced by Cheng-Zhong Xu and Gauthier Sallet in [506 for quite general linear 
hyperbolic systems. 

The time derivative of this function along the trajectories of the linear approx- 
imation (13.841 is 



U(t) = -iiU(t) - \Ae-^l^ L a 2 {t, L) - Aa 2 (t, 0) 
- \Bb 2 {t,0) - Be ( ^ L b 2 (t,L) 



It can be seen that the two last terms depend only on the Riemann invariants at the 
two boundaries, i.e., at x = and at x = L. The control laws Ua(t) and u^it) can 
then be defined in order to make these terms negative along the system trajectories. 
A simple solution is to select Uo(t) such that 

(13.85) a{t,0)=kob(t,0), 
and ui,(t) such that 

(13.86) b(t,L) = k L a(t,L), 

with | fco-fci | < I- The time derivative of the Lyapunov function is then written as 

(13.87) U(t) = -nU(t) + (Bk 2 L e wi)L - A e - (M/e)L )a 2 (i, L) 

+ {Ak 2 -B)b 2 (t,0). 

Since I/co^lI < lj we can select /i > such that 

k 2 G k 2 L ^\k k L \ < e -^((i/e)+(iM) , 

Then we can select A > and B > such that 

k\ A 1 

-ML((l/5) + (l/d)) < B < fc? 







(with the convention 1/fcjj = +°° if ^o = 0); which readily implies that 



(13.88) 



J\-f£r\ 



B < and Bk 2 e {p/d)L - Ae~^'^ L < 0. 



Then it can be seen that U(t) ^ —fiU(t) along the trajectories of the linear ap- 
proximation (13.84) and that U(t) = if and only if a(t,x) = b(t,x) = (i.e., at 
the system steady-state). 

In the next section, we show that such boundary controls for the linearized sys- 
tem (13.84) can also be applied to the nonlinear system (13.83) with the guarantee 
that the trajectories locally converge to the origin. 
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:i(ir, 



13.4.3. Convergence analysis. In the previous section (Section 13.4.2), the 
inequality U(t) ^ —fill ensures the convergence in the L 2 (0,L)-norm of the solu- 
tions of the linear system (13.84). As we shall see hereafter, in order to extend 



the analysis to the case of the nonlinear system ( |13.83 ), we will need to prove a 
convergence in H 2 (0, L)-norm (see for instance |476) Chapter 16, Section 1]). 



In the previous section, we considered linear boundary conditions (13.85) 



(13.861. Here we assume more general nonlinear boundary conditions. More pre- 



cisely, we assume that the boundary control functions Uo{t) and «i(i) are chosen 
such that the boundary conditions have the form 



(13.89) a(t,0) 

with C 1 functions a, (3 : R 



a(b(t,0)) and b(t,L) = 0(a(t,L)), 

> R, and we denote 

k = a'(0) and k L = /3'(0). 

The goal of this section is to prove the following theorem. 

Theorem 13.11. Let us assume that \kokL,\ < 1- Then there exist positive 
real constants K, 6, A such that, for every initial conditions (a , b°) in H 2 (0,L) 2 
satisfying the compatibility conditions 

(13.90) o°(0) = a(6°(0)), b°(L) = (3{a°{L)) 7 

(13.91) c(a°(0), 6°(0))a°(0) = -a'(b°(0))d(a o (0),b o (0))b o x (0), 

(13.92) d(a°(L),b°(L))b x (L) = -0'(a°(L))c(a o (L), b°(L))a° x (L), 
and the inequality 

\\a°\\HH0X) + \\b \\HH ,L)<S, 



the closed-loop system (13.83) with boundary conditions (13.89) has a unique solu 



tion in C ([0, +oo); H (0, L)' z ) and this solution satisfies, for every t G [0, - 



IK*, OIUw) + \\b(t, Ol|j^(o,i) < K (||a || Ha(0 ,i) + ||6°|| 



Oil ^ „— A< 



One can also get Theorem 



13.11 



(in the C^-norm instead of the i7 2 -norm) 
by using theorems due to James Greenberg and Ta-tsien Li [203] and to Ta-tsien 
Li [3T61 Theorem 1.3, Chapter V, page 173]. The proofs of [203 and of [316 
Theorem 1.3, Chapter V, page 173] rely on direct estimates of the evolution of the 
Riemann invariants and their derivatives along the characteristic curves. Note that 
a strict Lyapunov function might be interesting for robustness issues which may 
be difficult to handle with these direct estimates. For example, using our strict 
Lyapunov function and proceeding as in the proof of Theorem |13.11[ one can get 
the following theorem on the systems 

(13.93) a t + c(o, b)a x + g(x, a, b) = 0, b t — d(a, b)b x + h(x, a, b) = 0, 

Theorem 13.12. Let us assume that |fco^L| < 1- Then there exists a positive 
real number v, such that, for every g and g of class C 2 on a neighborhood of 
[0,L] x {0} x {0} in [0,L] x R x R satisfying 

a(x,0,0) = 0, (3{x,0,0) = 0, Vie e [0,L], 
dg „, dh , „ N dh , 



dg 

Oa 



(a;,0,0) 



Ob 



foo.o) 



Oa 



(i,0,0) 



da 



(1,0,0) 



<i/, \/xe [0,L], 



:i(i(i 
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there exist K > 0, A > and 5 > such that, for every initial condition (a , b°) in 
H 2 (0,L) 2 satisfying the compatibility conditions 

a (0) = a(b (0)),b (L)=l3(a°(L)), 



c(a°(0),b o (0))a x (0)+g(0,a o (0),b (0)) 

= -a'(b°(0))(d(a°(0),b (0))b x (0) - h(0,a°(0),b°(0))), 

d(a°(L),b°(L))b x (L) - h(L,a°(L),b°(L)) 

= -(3'(a (L)){c(a Q (L),b°(L))a x (L) + g(L,a°(L),b°(L))), 
and the inequality 

\\a°\\m(o,L) + \\b \\HHo,L)<S, 



the closed-loop system (13.93) with boundary conditions (13.89) has a unique solu- 
tion in C ([0, +oo); H 2 (0, L) 2 ) and this solution satisfies, for every t € [0, +oo), 

IK*, OIUW) + IW*> -)\\h*(0,l) < K (Ha°ll^(o,L) + ||6°IU"(o,L)) e~ Xt - 

We could also consider the cases where c and d depend "slightly" on x £ [0, L] 
(in the sense that c x (x,0,0) and d x (x,0,0) are small). For robustness studies using 
direct estimates of the evolution of the Riemann invariants and their derivatives 
along the characteristic curves, see [316, Theorem 1.3, Chapter 5, page 173] by 
Ta-tsien Li, and [396J by Christophe Prieur, Joseph Winkin and Georges Bastin. 

Proof of Theorem 13.11 By computing the time derivative of U(t) along 
the solutions of the system (13.831, we get 

u = 



A— e -^ x / 1 



i L 



C 

c 2 

,2, 



d 



A a "J! J 'c- (ux/g> + B h2 -' J 'c +(ux/S) 

d 2 



o 

dx 



4Ul e -W«l _ B b -^e + ^ lx/d) 



ay 

c 



dx, 



with 



dc dc dd dd 

«itt + "xtw, V '■— d x = a x — + b x — . 
da ob da db 



Let us introduce the following notations: 

v(t, x) := a x (t, x) and w(t,x) := b x {t,x). 

Then straightforward computations using integrations by parts lead to the following 
lemma. 

Lemma 13.13. If \koki\ < 1 an d if the positive real constants /i, A, B sat- 
isfy inequalities (13.88), there exist positive real constants K\,5\,\i such that, if 
\a{t,x)\ + \b(t,x)\ < 6i, Vx e [0,L], then 

U ^ -XiU + K X I [a 2 {t,x) + b 2 {t,x)} [\v{t, x)\ + \w{t, x)\] dx 



along the solutions of the system (13.83) with the boundary conditions (13.89). 
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:5(>7 



In contrast to the linear analysis of Section |13.4.2| on page |363[ it appears 
readily from Lemma |13.13| on the preceding page that we cannot just complete 
the Lyapunov stability analysis with the function U but that we have to examine 
the dynamics of the variables v(t, x) and w(t, x) and consequently to extend the 
definition of the Lyapunov function. 



By a time differentiation and using the model equations (13.83), it is readily 
shown that v(t,x) and w(t,x) satisfy the dynamics 

(13.94) vt + c(a, b)v x + v4> = 0, Wt — d(a, b)w x — wip = 0, 

and the associated boundary conditions 



(13.95) 



c(t,0)v(t,0) = -a'(b(t,0))d(t,0)w(t,0), 
d(t, L)w(t, L) = ~/3'(a(t, L))c(t, L)v(t, L). 



Here c(t,0), d(t,0), c(t,L) and d(t,L) are compact notations for the values of the 
functions c and d evaluated at (o(i,0), bit, 0)) and (a(t, L),b(t, L)) respectively. 

In fact, we also need to examine the dynamics of the spatial second order 
derivatives of a(t, x) and b(t,x), which are denoted as 

q(t, x) := v x (t, x) = a xx (t, x), r(t, x) := w x (t, x) = b xx (t, x). 



They satisfy the dynamics 
(13.96) 



q t + c{a, b)q x + 2q<p + v<p x = 0, 
r t - d(a, b)r x - 2rij) - wp x = 0, 

with the associated boundary conditions 
(13.97) 

c(t, 0)q(t, 0) + v(t, 0)(f>(t, 0) = rj'(t)w(t, 0) 

+ r)(t)[d(t, 0)r(t, 0) + w(t, 0)tp(t, 0)] 
d(t, L)r(t, L) + w(t, L)iP(t, L) = - X '{t)v(t, L) 

+ X (tMt,L)q(t,L)+v(t,L)(j>(t,L)]. 

Here (j>(t,0), ip(t,0), are compact notations for the values of the functions <f> and 
tp evaluated at (a(t, 0), b(t,0),v(t,0), w(t, 0)), and <fi{t,L) and ip(t,L) are simi- 
larly compact notations for the values of the functions <j> and if) evaluated at 
(a(t,L),b(t,L),v(t,L),w(t,L)). Finally the functions rj(t) and x(t) are defined as 



c(i,0) 



0'(a(t,L))c(t,L) 
d(t,L) 



A key point for the proof of Theorem |13.11 is the fact that the linear approximations 
(around zero) of systems (13.941 and (13.96) have the following form: 



v t + cv x 


= 0,w t - 


- dw x = 


qt + cq x 


= o, n - 


- dr x = 0. 



Both systems have exactly the same form as the linear approximation (13.841 of 



the original system (13.83). Then, in order to prove that the solutions of the global 



system (13.83), (13.941, (13.96) converge to zero, it is quite natural to consider an 



extended Lyapunov function of the form 

S(t) = U{t) + V(t) + W{t), 



:i(iS 
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where V(t) and W(t) have the same form as U(t): 

V(t):=V 1 (t) + V 2 (t) 1 

Vi{t) := cA / v 2 {t,x)e-^/^ x dx, V 2 {t) := dB / w 2 {t, x)e^ /d)x dx, 
Jo Jo 



and 



W(t):=W 1 (t) + W 2 {t), 



- ; ' ' " 2 {t,x)e- {t * /E)x dx,W 2 {t):=d 3 B r 2 (t,x)e w3)x dx. 



Wi(t) :=c 3 A / q 2 {t 

Jo Jo 

Let us now examine the time derivatives of the functions V(t) and W(t) along the 

solutions of the closed-loop system fll3.83| , ( |13.89| , ( |13.94| -( [l3!95| )-( |13.96| -( |l3.97 l. 

Straightforward (but lengthy) computations using integrations by parts lead to the 

following lemmas. 

Lemma 13.14. // |fcofci| < 1 and if the positive real constants \x, A, B sat- 
isfy inequalities (13.88), there exist positive real constants K 2 ,5 2 ,\ 2 such that, if 
\a(t,x)\ + \b(t,x)\ < 5 2 , Va; e [0,L], then 

V^-X 2 V + K 2 f [v 2 {t,x) + w 2 {t,x)] 3/2 dx 
Jo 



along the solutions of the systems (13.83), (13.94) with the boundary conditions 
(13.89$ and (13.95$ . 

Lemma 13.15. // |fc fci| < 1 and if the positive real constants [x, A, B sat- 
isfy inequalities (13.88), there exist positive real constants K 3 ,S 3 ,X 3 such that, if 
\a{t,x)\ + \b(t,x)\ < S 3 , Vie [0,L], then 

W ^-X 3 W + K 3 f (q 2 {t,x) + r 2 {t,x)) (\v(t,x)\ + \w(t,x)\) dx 



+ K 3 / (v 2 (t,x)+w 2 (t,x))(\q(t,x)\ + \r(t,x)\)dx 
Jo 



along the solutions of the systems ( 13.83$ , (13.94), (13.96) with the boundary con- 
ditions (13.89$ , ^jUfBj , (18.91$ . 

We are now in a position to complete our Lyapunov convergence analysis. We 
start with the analysis of the global Lyapunov function S = U + V + W. From 
Lemma |13.13| on page |366[ Lemma |13.14| and Lemma |13.15[ we readily get the 
following lemma. 

Lemma 13.16. If \kok^\ < 1 and if the positive real constants \x, A, B satisfy 
inequalities (13.88), there exist positive real constants A and 5q such that, if S(t) < 
5q, then 

5< -X S 



along the solutions of the closed-loop system (13.83), (13.89), (13.94), (13.95), 
(l3~96$ , {13.91$ . 

From [476, Chapter 16, Proposition 1.18, p. 364], we know that two solutions 



C°{[0,T);H 2 {0,I)) 2 nC 1 ([0,T);H 1 {0,I)) 2 nC 2 ([0,T);L 2 (0,L)f 
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of the Cauchy problem (|13.83), (13.891 with the same initial condition are equal 



on [0, T). (Actually |476j deals with K instead of [0, L] but the proof can be easily 
adapted). 

Furthermore, concerning the existence of solutions to the Cauchy problem, we 
have the following result from |476| Chapter 16, Proposition 1.5, p. 365]. There ex- 
ists 64 > such that, for every initial condition (a (%), b (x)) £ H 2 (0, L) 2 satisfying 



the above compatibility conditions ( 13.90 1-( 13.91 1-( 13.92), if every solution 
(a, b) e C°([0, T), # 2 (0, L)) 2 n C^QO, T), H 1 ^, L)) 2 n C 2 ([0, T), L 2 (0, L)) 2 



of the Cauchy problem (13.831, (13.89 1 with the initial condition (a(0, ■), 6(0, ■)) = 
(a , b°) satisfies S(t) < 64 for every t € [0, T), then this Cauchy problem has a 
solution defined on [0, +00) and in 

C°([0, +00), H 2 {0, L)) 2 n C x ([0, +00), H x {0, L)) 2 n C 2 ([0, +00), L 2 (0, L)) 2 . 

(Again the proof in |476] deals with K instead of [0, L] but it can be easily adapted). 
Let M > be such that 

±S(t) < \\a(t, .)\\h H0 ,l) + \\b(t, .)\\h»(o,l) < MS(t). 

Then it follows from Lemma 113.161 that Theorem 113.111 holds with 

S := — m.in(d ,8i), K := M 2 , A := A . 



Remark 13.17. In the special case where // = 0, the Lyapunov function U 
is just an entropy function of the system in characteristic form linearized in the 
space of the Riemann coordinates. In references [120] and [125j . the interested 
reader will find an alternative approach to the boundary control design where the 
entropy is used as a Lyapunov function. It must, however, be emphasized that the 
entropy is not a strict Lyapunov function because its time derivative is not negative 
definite but only semi- negative definite (as we can see by setting /i = in equality 



( 13.87 1). In fact, the Lyapunov analysis made in references |120j and |125j . was 
only used as a guide to construct potentially stabilizing feedback laws. The proof of 
the asymptotic stability was obtained by using theorems due to James Greenberg 
and Ta-tsien Li [203 and to Ta-tsien Li [316, Theorem 1.3, Chapter V, page 173]. 

13.4.4. Application to level and flow control in a horizontal reach 
of an open channel. We consider a reach of an open channel delimited by two 
overflow spillways as represented in Figure [5] on the next page. We assume that 

1. the channel is horizontal, 

2. the channel is prismatic with a constant rectangular section and a unit 
width, 

3. the friction effects are neglected. 

The flow dynamics are described by a system of two conservation laws (shallow 



water equations, due to Saint- Venant |430j : see also Section 6.3 1, namely a mass 
conservation law 

H t + (HV) X = 0, 
and a momentum conservation law 

V t +(gH+^-) =0. 



370 



13. APPLICATIONS TO SOME PARTIAL DIFFERENTIAL EQUATIONS 



Here H(t, x) represents the water level and V(t, x) the water velocity in the reach, 
while g denotes the gravitation constant. 




► X 



Figure 2. A reach of an open channel delimited by two adjustable 
overflow spillways 



I 



f 



H 



One has 

/ HV 

\gH + * 

(V iT 

The eigenvalues of the Jacobian matrix f'(H, V) tT are 

\ X (H, V) = V + ^g~H, \ 2 (H, V) = V- ^g~H. 

They are real and distinct if H > 0. They are generally called characteristic 
velocities. The flow is said to be fluvial (or subcritical) when the characteristic 
velocities have opposite signs: 

X 2 (H,V) <0<X!(H,V). 

The Riemann invariants can be defined as follows: 

b = V -V-2{^g~H-^g~n). 

The control actions are the positions uq and ul of the two spillways located at the 
extremities of the pool and related to the state variables H and V by the following 
expressions: 

,3/2 



(13.98) 
(13.99) 



H(t,Q)V(t,Q)-Cv{Zv-u (t)y' =0, 



3/2 



H(t, L)V(t, L) - C (H(t, L) - u L {t)Y' = 0, 



where Zq denotes the water level above the pool (see Figure pi and Cq is a charac- 
teristic constant of the spillways. 
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For constant spillway positions «o and ul, there is a unique steady-state solu- 
tion which satisfies the following relations: 



H = Z - u + u l , V 



C (Z - u ) 3/2 



Z -uo + u L 

The control objective is to regulate the level H and the velocity V (or the flow rate 
Q = HV) at the steady-state H and V (or Q = HV), by acting on the spillway 
positions uq and u^. 



By using the relations (13.851 and (13.86) for the control definition, combined 



with the spillway characteristics ( 13.98 1-( 13.99 I, the following boundary control 
laws are obtained: 



U 



UL 



Ho 



V 



H L 



Hl 

Co 



V + 2^ 



l + k L 
l-k L 



WHl - VH) 



where H = H(t,0), H L = H{t,L). 

Let us emphasize that uq (resp. ul) depends only on the state at x = (resp. 
x = L). In addition, let us also point out that the implementation of the control 
is particularly simple since only measurements of the levels H(t,0) and H(t,L) 
at the two spillways are required. This means that the feedback implementation 
does not require level measurements inside the pool or any velocity or flow rate 
measurements. 

Remark 13.18. In order to solve the control problem, we selected the particular 
simple boundary conditions (13.851 and (13.86). But obviously many other forms 
are admissible provided they make U negative. For instance, it can be interesting 
to use controls at a boundary which depend on the state at the other boundary, 
hence introducing some useful feedforward action in the control (see e.g. [37,). 

Remark 13.19. There have been recently many results on the controllability 
of channels and network of channels. Let us mention in particular [3 T7\ 1318] by 
Ta-tsien Li, [320 by Ta-tsien Li and Bopeng Rao, [210] by Martin Gugat, Giinter 
Leugering and Georg Schmidt. 



APPENDIX A 



Elementary results on semigroups of linear 

operators 



In this appendix we recall some classical results on semigroups generated by 
linear operators with applications to evolution equations. We omit the proofs but 
we give precise references where they can be found. Let H be a complex Hilbert 
space. We denote by (x, y) the scalar product of two elements x and y in H. The 
norm of x € H is denoted ||x||. Let 

A : D{A) C H -> H 
x i— > Ax 

be a linear map from the linear subspace D(A) of H into H. Throughout this 
section we assume that A is densely defined, i.e., 

(A.l) D(A) is dense in H. 

Let us first recall some definitions. 

Definition A.l. The operator A is a closed operator if its graph (i.e., the set 
{(x, Ax); x € H}) is a closed subset of H x H . 

Definition A. 2. The operator A is dissipative if 

U{Ax,x) < 0, Vice L>(A). 

(Let us recall that, for z£C, !Kz denotes the real part of z.) 

Definition A. 3. The adjoint A* of A is the linear operator 

A* : D{A*) C H -> tf 
a: i— > ^4*a;, 

where 

• .D(A*) is the set of all y such that the linear map 

D{A) C H -> C 

£ i— > (Ax, y) 

is continuous, i.e., there exists C > depending on y such that 

(A.2) KAc^KCIIsll.Vaje-DtA). 

• For every y G D(A*), A*y is the unique element of H such that 
(A.3) (Ax,y) = (x,A*y),Vx€D(A). 



tence follows from (A.2 I 



(The uniqueness of A*y such that (A.3 1 holds follows from (A.l I, the exis 



:1V.( 
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We can now state the well-known Lumer-Phillips theorem (see for example 
[3811 Corollary 4.4, Chapter 1, page 15]). One could alternatively state the Hille- 
Yosida theorem; see, for example, [711 Theorem VII. 4, page 105] or [381, Theorem 
3.1, Chapter 1, page 8 and Theorem 1.3 page 102]. 

Theorem A. 4. Let us assume that A is densely defined and closed. If both A 
and A* are dissipative, then, for every x° € D(A), there exists a unique 

x £ CWO, +oo);H) n C°([0, +oo); D{A)) 



(A.4) 
such that 

(A.5) 
(A.6) 
One has 

(A.7) 

(A.8) 



dx 
~dt 



- Ax on [0, +oo) 
x(0) = x°. 



(I) 



||s(t)||<||s°||,Vte[0,+oo), 

\\Ax(t)\\^\\Ax \\,Vt£[0,+oo) 



In (A.4) and throughout the whole book, the linear space D(A) is equipped 
with the graph norm ||3/||z?(X) : = \\v\\ + \\ A v\\- 

One also uses the following definition (see, for example, [381[ Definition 1.1, 
page 1]). 

Definition A. 5. A one-parameter family S(t), ^ t ^ oo, of continuous linear 
operators from H into H is a semigroup of continuous linear operators on H if 



s{h + 1 2 ) 



5(0) = Id, 

5(ii)o5(i 2 ),V(i 1 ,i 2 )e[0,+oo) 2 . 



In Definition |A.5| and in the following, Id denotes the identity map on H. By 
(A.l) and (A.7l, for every t Jj 0, the linear map x° € D(A) h- > x(t) G H can be 



uniquely extended to an element of C(H ; H), i.e., a linear continuous map from H 
into H. This extension is denoted S(t). One has 



S(h 



S(0) = Id, 

5(i 1 )o5(i 2 ),V(i 1 ,i 2 )e[0,+oo) 2 . 



Because of these two properties, S : [0, +00) — > C(H, H) is called the semigroup 



associated to the linear operator A. Note that (A.7) implies that ||/S r (t)||£(jj ; m $J 1, 
i.e., 



(A.9) 



S(t) is a contraction for every t G [0,+oo) 



Concerning the regularity of a semigroup, one has the following definition (see, 
for example, [381, Definition 2.1, page 4]). 

Definition A. 6. Let H be a Hilbert space and let S(t), t e [0,+oo), be a 
semigroup of continuous linear operators from H into H. One says that S is a 
strongly continuous semigroup of continuous linear operators on H if 



lim S(t)x 

4-.0+ 



x, \/x e H. 
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With this definition, it follows from (A. 4) that the semigroup S associated to 
A is strongly continuous. 

Concerning the inhomogeneous Cauchy problem, one has the following theorem 
(see, e.g., [139, Theorem 3.1.3, page 103]). 

Theorem A. 7. Let us assume that A is densely defined and closed. If both A 
and A* are dissipative, then, for every x° G D{A), for every T G [0, +00) and for 
every f G C 1 ([0,T]; H), there exists a unique 

(A. 10) x e c^Qo, +00); H) n c°([o, +00); d{A)) 

such that 

dx 
(A. 11) — = Ax + f(t) on [0,31, 

(A. 12) x(0)=x°. 



One has (compare with Proposition 1.9 on page\m 



(A. 13) x(t) = S{t)x° + f S{t- T)f{r)dT, Vt G [0, T]. 

Jo 

Concerning the behavior of the norm 1 1 5 (t)|| £(#-;#) of the continuous linear 
operators S(t) : H — > H, one has the following theorem (see, for example, [381 
Theorem 2.2, Chapter 1, page 4]). 

Theorem A. 8. Let S(t), t G [0,+oo) ; be a strongly continuous semigroup of 
continuous linear operators on H . Then, there exist C > and A G K such that 



\\S(t)\\c(H;H)^Ce M ,Wte[0 



-00 



Conversely, to every strongly continuous semigroup of continuous linear op- 
erators, one can associate a linear operator by the following definition (see, for 
example, [381, page 1]). 

Definition A. 9. Let S(i), t G [0,+oo), be a semigroup of continuous linear 
operators on H . Then the infinitesimal generator of S is the linear operator A : 
D{A) C H -> H defined by 

r^/ i\ f rr ,. S(t)x — X 

D(A) = < x G H; hm — — exists 

[ t^o+ t 

Ax = hm S ® X ~ X ,Vx€D(A). 

One has the following theorem (see, e.g., the proof of [381, Corollary 4.4, 
Chapter 1, page 15]). 

Theorem A. 10. Let us assume that A is densely defined and closed and that 
A and A* are both dissipative. Then A is the infinitesimal generator of the strongly 
continuous semigroup associated to the operator A. 

The main properties of the infinitesimal generator of a strongly continuous semi- 
group of continuous linear operators on H are summarized in the following theorem 
(see [38T1 Theorem 2.4, Chapter 1, pages 4-5], [381, Corollary 10.6, Chapter 1, 
page 41], [38T1 Theorem 1.3, Chapter 4, page 102]). 

Theorem A. 11. Let S(t), t G [0, +00), be a strongly continuous semigroup of 
continuous linear operators on H . Then 
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(i) The domain D(A) is dense in H and A is a closed linear operator. 
(ii) For every x° in D{A), there exists one and only one 

x £ C^QO, +00); H) n C°([0, +00); D{A)) 

such that 

x{t) £ D(A), Vie [0,+oo), 

dx 

— (t) = Ax(t),Vte [0,+oo), 

dt 

x(0) = x°. 
This solution satisfies 

x{t) = S(t)x°,\/te [0,+oo). 

(iii) S(t)*, t £ [0, +oo), is a strongly continuous semigroup of continuous linear 
operators and the infinitesimal generator of this semigroup is the adjoint 
A* of A. 

Some of the previous results and definitions can be extended to the case of 
groups of continuous linear operators. First, one has the following definitions (com- 



pare with Definition A. 5 Definition A. 6 and Definition A. 9) 



Definition A. 12. (See e.g. |381 Definition 6.1, page 22].) A one-parameter 
family 5(t), t € K, of continuous linear operators from H into H is a group of 
continuous linear operators on H if 

5(0) = Id, 
S(h + t 2 ) = S(h) o S(t 2 ), V(ti, t 2 ) £ R. 

Definition A. 13. (See e.g. [38T| Definition 6.1, Chapter 1, page 22].) Let 
S(t), t £ R, be a group of continuous linear operators from H into H. One says 
that S is a strongly continuous group of continuous linear operators on H if 

lim S(t)x = 1, Vi € H. 

Definition A. 14. (See e.g. [38T1 Definition 6.2, Chapter 1, page 22].) Let 
5(t), t G R, be a group of continuous linear operators on H. Then the infinitesimal 
generator of S is the linear operator A : D(A) C H — > H defined by 

,-w «n f TT ,. S(t)x — X 

D(A) = < x £ H; hm — — exists 

v ; \ ' t-o t 

Ax = lim S ^ x ~ x V x £ D(A). 
t-»o t 

The main properties of the infinitesimal generator of a strongly continuous 
group of continuous linear operators on H are summarized in the following theorem 



(see [381, Theorem 6.3, Chapter 1, page 23], and apply Theorem A. 11 to t 6 

[0,+oo) h* S(t) and to t£ [0,+oo) i-» S(-t)). 

Theorem A. 15. Let S(t), t £ R, &e a strongly continuous group of continuous 
linear operators on H . Then 

(i) The domain D(A) is dense in H and A is a closed linear operator. 
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(ii) For every x° in D(A), there exists one and only one 

xeC 1 {m.-H)c\C a {m.-D(A)) 

such that 

x(t) G D(A), Vt G R, 

dx 

— ft) = Ax(t), Vt gR, 

at 

x(0) = x°. 

This solution satisfies 

x{t) = S(t)x°, Vt G R. 

(iii) S(t)*, t G R, is a strongly continuous group of continuous linear operators 
and the infinitesimal generator of this semigroup is the adjoint A* of A. 



One also has the following theorem (apply Theorem A. 10 to A and — A) 



Theorem A. 16. Let us assume that A is densely defined and that A = —A*. 
Then A is the infinitesimal generator of the strongly continuous group of isometries 
on H associated to the operator A. 

Of course, in Theorem |A.16[ the strongly continuous group of isometries as- 
sociated to A is the group S(t), t G R, of isometries of H such that, for every 
x° G D(A), t h-> x(t) := S{t)x° is in C^R; H) n C7 (R; D(A)) and is the solution of 
the Cauchy problem 

da; 
dt= AX > 



x(0) 



„o 



(see page 374) 



Remark A. 17. There are powerful generalizations to the nonlinear case of 
most of the results of this section. In this case, the operators A are no longer linear 
but maximal monotone. See, in particular, the book [70| by Hai'm Brezis. 



APPENDIX B 

Degree theory 

In this appendix we construct the degree of a map and prove the properties 
of the degree we use in this book. As an application of the degree, we also prove 
the Brouwer and Schauder fixed-point theorems that we also use in this book. For 
more properties and/or more applications of the degree, we refer to [333] by Noel 
Lloyd, [373] by Mitio Nagumo, [438, Chapter III] by Jacob Schwartz. 

Throughout this appendix n is a given positive integer. Let us start with a 
theorem which defines the degree. Let D be the set of ((f>, 0, b) such that 

1. $7 is a nonempty bounded open subset of K™, 

2. is a continuous map from SI into W 1 , 

3. b€M. n \4>(dn). 

Theorem B.l. There exists a unique map 

degree : D — ♦ Z 

((f), SI, b) i— ► degree ((f>,Sl, b) 

satisfying the following four properties: 
(i) For every nonempty bounded open subset SI ofW 1 and for every 6e fl, 

degree (Id n \ u , SI, b) = 1. 

(We recall that Id„ denotes the identity map ofW 1 .) 
(ii) Let ((f>,Sl,b) £ D. Then, for every disjoint nonempty open subsets Six and O2 
of SI such that 

6^(n\(n 1 uo 2 )), 

one has 
(B.l) degree (<p, SI, b) = degree (^ , fi ls b) + degree (^ ,fl 2 ,b). 

(Hi) For every (if), Q, b) € D, there exists e > such that, for every ip € C (SI; R") 
satisfying 

ll0-Vilc°(n;R») < £ > 
one has 

degree (ip, SI, b) = degree ((/>, SI, b). 
(iv) For every ((f>, SI, b) € D , 

degree (4>, SI, b) = degree ((f) — b, SI, 0), 
where <f> — b is the map from SI into K n defined by 
(cf) - b)(x) = (f(x) - b, ViGfl. 
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Moreover, this degree map is such that, for every (0, £2, b) G D satisfying 



(B.2) 

(B.3) 

one /ias 
(B.4) 



is of class C m £2, 
((/)(x) = b,x efl)=> (<j)'(x) e £(R";R") «s mvertible), 



degree (4>,Q,b) = \. Sign (det 0'(ir)), 



with the convention that, if <j> 1 (6) is empty, then the right hand side of (B.4) is 



Note that (</>,£2,o) G D, (B.2 1, (B.3 1 and the inverse function theorem imply that 
4>~ l {b) := {x G £2; 4>{x) = b} is a discrete set and therefore a finite set since £2 is 



compact. Hence the right hand side of (B.4 I is well defined 



Proof of Theorem |B.1[ We only construct a map degree : D — > Z satisfying 



(p) to (hvj), together with ( |B.4| if (B.2 I and (B.3 1 hold. For the uniqueness statement, 
which is not used in this book, we refer to [333, Theorem 5.3.2 page 88].) Our proof 
is organized as follows: 

- In Step 1, we define some integer di{<f>, £2, b) when (f> is of class C 1 in £2 and 



if 6 is a regular value, i.e., if (B.3) holds. This integer will turn out to be 



equal to degree (0, £2, b) under these assumptions. 

- In Step 2, we prove a vanishing result for certain integrals. 

- In Step 3, using this vanishing result, we define some integer d^^i ^ °) by 
an integral formula when (j) is of class C 1 in £2. This integer will again turn 
out to be equal to degree (<$>, £2, b) under this smoothness assumption. 

- Finally, in Step 4, we treat the case where (j> is only continuous and define 
degree ((/>,£2, b). 



Step 1: The regular case. In this step, (</>, fi,6) G D is such that (B.2) and 



(B.3 1 hold. Then one defines di(</>,£2,&) G Z by 
di (0,n,6):= 



(B.5) 



]T Sign(det <//(£)), 



with the convention that, 

(B.6) if <fi~ (b) is empty, then the right hand side of (B.5) is 0. 



(Note that, since we want to have (B.4), this is a reasonable choice! 



Step 2: An integral formula. In this step, (<f>, £2,6) G D is such that (B.2) 



holds. We do not assume that (B.3 1 holds. For r > 0, let C(b,r) be the hypercube 
C(b,r) := {y := (y u . . . , y n f G K"; \ Vl - b z \ < r, Vi G {1, . . .,«}}, 



where (61, ... , b n ) tr := b. Let p{4>, £2, b) be the supremum of the set of r > such 
that C(b, r)cl"\ <f>(dQ). We define the hypercube Q(<j>, £2, 6) by 

Q(<f>, £2, 6) := C(6, p(t/>, £2, 6)) C K n \ 0(9£2). 

Let us denote by J^ the Jacobian determinant of <f>, i.e., the determinant of </)'. One 
has the following proposition. 



B. DEGREE THEORY 381 

Proposition B.2. Let F e C°(R n ) be such that 
(B.7) the support of F is included in Q((f>,Cl,b), 

(B.8) f F(y)dy = 0. 

Then 

(B.9) / F(4>(x))J4,{x)dx = 0. 

Proof of Proposition |B.2[ By density arguments, we may assume that 

(B.10) <j> is of class C 2 in CI, 

(B.ll) FeC\R n ). 

Let us assume the following proposition, which has its own interest and will be 
proved later on. 

Proposition B.3. Let (ffli)ie{i n } and (6i)jg{i ) ..., n } be two sequences of n 
real numbers such that 

<H < h, V* G {1, ... ,n). 

Consider the hypercube Q := {y : = (yi, . . . ,y n ) tr ; y t G (a<,&i), Vi G {l,...,n}}. 
Let F G C 1 (M n ) be such that pTg| ) ZioZds and 

(B.12) i/je support of F is included in Q. 

Then there exists Y = {Y x , . . . ,Y n ) tr G C 1 (R n ;R n ), y := (yi, . .. ,y n ) tr •-> K(y) 
smc/i i/iai 

(B.13) i/je support ofY is included in Q, 

(B.14) div y := V ^ = F. 

f^dy t 

We apply this proposition with Q := Q(4>,Cl,b). Let 
I:=(I 1 ,...,I„) t '6C 1 ((!;I") 



be defined by 



(B.15) 



Xi := det (Y(<j)),(f) X2 ,(j) X3 ,...,(j) Xn ), 
X 2 := det (cf> Xl ,Y(4>),(j) X3 ,...,(j) Xn ), 



X n := det (4> Xl ,<j> X2 ,... ,(fi Xn _ 1 ,Y(4>)). 
Clearly, 

(B.16) the support of X is a compact subset of CI. 

Let us check that 
(B.17) div X(x) = div Y(cf>(x))J4,(x), \/x G O. 



:;n2 
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Straightforward computations show that 

div X = det (Y'(<j>)^ Xl ,^ Xa ,</) Xs ,...,</) Xn ) 

+ det (cj) Xl ,Y'((f>)4> X2 ,(t) X3 ,...,(t) x J 
(B.18) . 

+ det ((j) Xl , <j> X2 , . . . , <^ a . B _ 1 , Y' {(f>)<p Xn ) . 

For M G M„, B (1) and a := (01, . . . , a„) G (R") r \ let 

A(M, a) := det (Mai,a 2 ,a 3 ,. . . ,a„) 
+ det (oi, Ma 2 ,a 3 ,. . . , a„) 



+ det (ai,02,...,a„_i,Mo„). 

Clearly, A(M, ■) is multilinear in ai, 02, . . . , a„ and vanishes if two of the a^'s are 
equal. Hence there exists K(M) G K such that 

A(M,o) = if (M) det a, Va G (R") n = M n , n (T8L). 

Taking for a the canonical basis of R™, one gets that K(M) is the trace of M. 
Therefore, 

(B.19) A(M,a) = (trace M) (det a), Va G (R™)" = M n , n (R), VM G M„,„(K). 

Using (B.18) and applying (B.19 I to M := V ((/>) and a^ := c/)^^, i G {1, . . . , n}, one 



gets (B.17I 



Let us point out that if O is a nonempty open subset of K and 9 G C (O) is 
such that its support is a compact subset of O, then 



(B.20) 



9'(x)dx = 0. 



Indeed, it suffices to extend 9 to R by requiring 0(a;) = for every x G R\ O. This 
new is of class C 1 in K and has a compact support. In particular, 

9'(x)dx = 0, 



which implies (B.20 1. Therefore, using (B.14l, (B.16I, (B.17 1 and the Fubini theo- 
rem, we get 



F((j)(x))J^x)dx = / div Y(4>(x))J<t,(x)dx = / div X{x)dx = 0. 



This concludes the proof of Proposition B.2 assuming Proposition B.3 



Proof of Proposition |B.3[ Our proof will not use any geometrical tool. For 
a similar proof, but written in the language of differential forms, see, e.g. |51| 
Lemme 7.1.1, Chapitre 7, page 263] by Marcel Berger and Bernard Gostiaux (for 
an English translation, see [52 ). 

We proceed by induction on n. For n = 1, it suffices to take 

Y(y) := f F(t)dt. 



(By (B.8l, the support of Y is included in Q = (ai,bi).) We assume that Proposi- 
tion B.3 holds for n and prove it for n + 1. Let (ai)ie{i,..., n } an d (&i)ie{i,..., n } be 
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two sequences of n + 1 real numbers such that 

at < bi, Vi € {1, . . .,n,n+ 1}. 

Let Q := {y := (y u . . . , y n y n+ i ) tr ; y t G (a;,&;),Vi G {1, . . . ,n,n + 1}}. Let 
F G C 1 (K™ +1 ) be such that (|B.12| holds and 



F(y)dy = 0. 

jRn + l 

We write, for y G R n+1 , 



;=\ v 

\2/n+l 

with y G R". Let F G C^R") be defined by 

F(y):= I f( V )dy n+1 . 
J M \Vn+lJ 

Then 

the support of F is included in Q c 1", 

i^)# = 0, 

where Q := {y := (y 1; .. . ,y n ) tT ; Vi G (a.,,6.,), Vi G {l,...,n}}. Hence, applying 
the induction assumption, there exists Y := (Yi, . . . , Y n ) tT G C^R™^™), y := 
(?/i, • • • ,2/n) tr i-» Y{y), such that 

the support of Y is included in Q C R n , 

div y := y- ^ = F . 
fridy, 

Let p G C 1 (R) be such that 

the support of p is included in (a„+i, b n +i), 

p(t)dt= 1. 
Then, if we define Y := (Yi, . . . , Y n , Y„+i) tr G C 1 (E™ +1 ; R" +1 ) by 

Yi ( ti V )■= p(y n +i)Yi(y), Vi G {1, . . . , n}, My G R'\ Vy„ +1 G R, 

Fn+1 Lli) := /"' ' (^ (<) " P( * ) ^^ ) ) ^' V ^ G K "' V2/n+1 G R ' 
one easily checks that 

the support of Y is included in Q, 

U+1 r»V- 

d[vY ., = y^l = F . 

This concludes the proof of Proposition |B.3| ■ 



:',s 1 



B. DEGREE THEORY 



Step 3: The case of maps of class C . Throughout this step, (4>, fi, 6) G D 

and is assumed to be of class C 1 in Q. Let / G C°(K") be such that 



(B.21) the support of / is included in Q(4>, fi, b), 

(B.22) / f(y)dy = l. 

One defines 

(B.23) d 2 (cf>,n,b) := / f{(j>(x))J^{x)dx. 

Jo 



From Proposition B.2 we get that d 2 (<f>,£l,h) is independent of the choice of / G 
C°(M n ) satisfying ( |B~2l) ) and ( |B.22| . 
One has the following proposition. 



Proposition B.4. If (B.3) holds, then 
(B.24) 



d!(<f>,n,b) = d 2 (4>,n,b). 



Proof of Proposition B.4, As mentioned above on page 380 (B.3 I, which 
is assumed, implies that <j)~ l (b) is a finite set. Let us first treat the case where 
cj)- l (b) = 0. Then, by ( |b~5| and ((Re!, 

(B.25) d 1 {(j),n,b) = 0. 

Moreover, there exists an open neighborhood V of b in K n such that 

(B.26) VcQ(<t>,Sl, b), 0(^)0^ = 0. 

Let / G C°(R n ) be such that 

(B.27) the support of / is included in V, 

(B.28) / f(y)dy=l. 



From (B.23 1, (B.26 1, (B.27 1 and (B.28 1, 



da(^n,6)= / /(</>(*)) J^di = 0, 
Jn 



which, together with (B.25), gives (B.24l. 

Let us now deal with the case where <^ _1 (&) is not empty. One writes 

<t>~ 1 {b) = {xi,x 2 ,.-.,Xk}, 

with k G N \ {0} and ccj 7^ cCj if i 7^ j. By the inverse function theorem, there 
exist k open subsets wi, . . . , Wfc of R n and £ > such that, defining -B(6, e) := {y G 
R"; |y-b| < 

Xi G uJi, Vi G {1,.. . ,fc}, 

Wj fl Wj = 0, V(i, j) G {1, . . . , fc} 2 such that ? 7^ j, 

B(b,e)cQ(c/),n,b), 

k 

4>- 1 (B(b,e)) = \Ju Jl7 



. is a difieomorphism between u>, and B(b,e), Vi G {!,...,&}. 
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Let / G C"(R n ) be such that 



support / C B{b,e), 
f(y)dy = l. 



One has, using (B.23I and the changes of variables y 
i G {1,. .. ,k} and y G B(b,e), 



^(x), where a; G 



d 2 {(j>,£l,b) = f Q f((j)(x))J<p(x)dx 

= Ei=i L 4 f{<l>{x))J^{x)dx 

= ELi Si g n ( J 0(^))/ B (b, e )/(2/) d ?/ 



which, together with (B.5), concludes the proof of Proposition B.4 



Our next proposition follows. 

Proposition B.5. The map b e K" \ (j)(dQ,) -»1, 6 m d 2 (^,n, 6), is continu- 
ous. Moreover, the real number d2(4>,Q,b) is an integer. 



Proof of Proposition |B.5[ The continuity statement follows from the fact 
that if / € C°(R") has a support included in the bounded open set Q((j>, fi,6), 
then, for every b 1 G R n close enough to b, f € C°(K") has a support included 
in Q(4>, f2, 6'). In order to prove that the real number d2(4>,£l,b) is an integer, it 
suffices to point out that, by the Sard theorem (see, e.g., |1641 Theorem 3.4.3, page 
316] or J202I Theorem 1.12 and Note (1) page 34]), there exists a sequence (bk)kefi 
of elements of R" \ (f>(dQ.) such that 

(B.29) (4>(x) = b k ) => (</>'(x) G C(R n ; R n ) is invertible), Vfc G N, 

(B.30) bk — * b as k — > +oo. 



By Proposition B.4 and the definition of di (see (B.5) and (B.6l) 

d 2 {^,n,b k ) = d 1 {<j>,n,b k )ez, 



which, together with (B.30) and the continuity of d2((f>, O, •); shows that d^{4>, fi, &) G 
Z. This concludes the proof of Proposition |B.5[ ■ 



The next proposition establishes the properties of d 2 analogous to Propertie s (p| 
to (hvl) of the degree map (4>, Q,b) € D i—> degree ((/>, f2, b) required in Theorem B.l 
on page |379| 

Proposition B.6. The map d 2 satisfies the following four properties, 
(i) For every nonempty bounded open subset £7 ofW 1 and for every b G £1, 

d 2 (Id„| iy) n,6) = l. 



:;*() 
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(ii) Let (<f>, tt,b) E D be such that <f> is of class C 1 in 0. Then, for every disjoint 
nonempty open subsets fJj and fl 2 of fl such that 

6 0(n\(fiiun 2 )), 

one ftas 

(B.3i) d 2 (^,n 1 b) = d 2 (^ i ,n 1 ,b) + d 2 ((b\ fl2 ,n 2 ,b). 

(in) Let il be a nonempty open subset ofW 1 and b G R™. Let 

HeC°([0,l] xn;R") 
&e smc/i that 

H(t,x) /o, V(i,x) G [0,1] x 0ft, 

-ff(£, ■) is of class C in f2, for every t G [0, 1], 

ri M 

the map (t,x) G [0, 1] X Vt (-> — — G £(R n ;R n ) is continuous. 



Then 
(B.32) 
(wj -For ewery 



,n. 



d 2 (ff(o > .),n > 6) = d 2 (H(i,-),n ) 6). 

G -D smc/i i/iai <f> is of class C l in Q, 
d2^,n,b) = d 2 ((f>-b,Q,0). 



Proof of Proposition B.6, Property <JT1> follows directly from (B.5I and 



Proposition B.4 



on page 



384 Property (pl| clearly holds if & is a regular value, i.e 



if (B.3) holds. One deduces the general case from this particular case by using the 



continuity of d 2 with respect to b (Proposition B.5 I and the density of the regular 
values in R n . (This density, as mentioned above, follows from the Sard theorem.) 
Concerning Property ( |iii[ ) , proceeding as in the proof of the continuity of d 2 with 
respect to o, one gets that 



(B.33) 



t G [0,1] i— > d 2 (H (t, ■), f2, 6) is continuous. 



Equality (B.32) then follows from (B.33 I and the fact that, for every t G [0,1], 



d 2 (H(t,-),n,b)e 



(see Proposition B.5 I. Finally, Property (hy 



d 2 - This concludes the proof of Proposition 



) readily follows from the definition of 
B~6l ■ 



Step 4: The case of maps of class C°. Let (</>, f2,&) G D. Let 

5{4>,n,b) := dist (&,<£(#fi)) := min{|6 - <f>{x)\; x£ dfl}. 

Since (<p,fl,b) G D, 5(4>,fl,b) > 0. Using standard smoothing processes, one gets 
the existence of ip G C°(f2; K") of class C 1 in f2 such that 

(B.34) U-i;\\ com <S^,n,b). 

We define degree (<fi, 57, b) by 

(B.35) degree {<j>, ft, b) := d 2 (ip, fl, b) G Z. 

Our next lemma shows that this integer is independent of the choice of ip. 
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Lemma B.7. Lettpi, i e {1,2}, be two elements ofC°(Q,;M. n ) which are of class 
C 1 in fl. Assume that 



Then 



||^-^i|| C o ( n)<*(0,n,6),V*e{i > 2}. 



d 2 (Vi,0,6) = d 2 (V' 2 ,0,6). 



Proof of Lemma B.7, It suffices to apply Property (mil) of Proposition B.6 
to the map H G C°([0, 1] x fi;R") denned by 

H(t,x) :=tipi(x) + (l-t)tp 2 (x),'i(t,x) € [0,1] xfi. 



Note that, by taking ip = (f> if <fi is of class C 1 in 0, one has 
(B.36) degree (<f>, O, b) = d.2(4>, Q, b), if 4> is of class C 1 in f2. 



In particular, using (B.5l and Proposition B.4 one sees that (B.2) and (B.3l imply 



(B.4|. It is easy to check that degree : D — > Z satisfies all the other properties 
mentioned in Theorem |B . 1 1 on page |379) This concludes the proof of this theorem. 



Let us now give some immediate applications of Theorem |B . 1 1 applications that 
we have previously used in this book. As a corollary of Property ( pfi[ ) of Theorem 
|B.1| one has the following proposition. 



Proposition B.8 (Homotopy invariance of the degree). Let f2 be a nonempty 
open subset ofW 1 , H € C°([0, 1] x 0;M n ), and b e R™. We assume that 

H(t,x) /6, V(i,x) e [0,1] x dn. 

Then 

degree (H(0, ■), O, 6) = degree (if (1, -),Q, b). 



Similarly, as a corollary of Properties (hiij) and (hy| of Theorem B.l one has 
the following proposition. 

Proposition B.9. Let (<j>,£l,b) e D. There exists e > such that, for every 
b' e R n such that \b-b'\ < s, 

(<f>, Q, b') e D and degree (<f>, f2, b') = degree (4>, Q., b). 



As a consequence of Property (hl| of Theorem B.l on page 379| one has the 
following two propositions (Propositions [bTIO and B.ll I. 



Proposition B.10. Let (</>,Q,b) e D be such that bg 0(fi). Then 
(B.37) degree (<j),tt, b) = 0. 



Proof of Proposition B.10 We give a proof relying only on Property ml]) 
of Theorem B.l (we could also give a simpler proof using our construction of the 



degree). Let wi, 0J2 and W3 be three nonempty disjoint open subsets of Q. Writing 



(B.l I with Qi := wi and Q2 '■= ^2, one has 

(B.38) degree (0, $7, 6) = degree (^\ mi ,wi, b) + degree (</>\u a ,U2,b). 



:sss 
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Writing equality (B.l I with Oi := U)\ U oj 2 and fi 2 '■= k>3, one has 



(B.39) degree (<j>, ft, b) = degree (</>\ UlUu>2 ,Ui U w 2 ,b) + degree {(j)\u 3 , u> 2 , b). 



However, writing ( |B.1| for (<j),fl,b) := ((t>\ ^j^ ,ViUu 2 , b) and (fli,fl 2 ) := (wi,w 2 ), 
we get 

degree (</> L lUa , 2 , Wi U w 2 , 6) = degree (01^ , Wi, 6) + degree (c/>|^ 2 , w 2 , 6), 



which, together with (B.38) and (B.39), implies that 



degree (^1^, w 3 , 6) = 0. 
Similarly, one has 
(B.40) degree (cj>\ Z j 1 ,ui 1 ,b) = degree (<£b a ,W2, 6) = 0, 



which, together with (B.38), concludes the proof of Proposition B.10 



Proposition B.ll (Excision property). Le£ (0, fi, 6) G D. lei O &e a noti- 
empty open subset of ft suc/i i/iai 6 ^ </>(£! \ f2 ). T/jen 



(B.41) 



degree (</>, O, 6) = degree (0|^-, O , 6). 



Proof of Proposition B.ll Since b (f>(dft), there exist disjoint nonempty 



open subsets fi\ and ft 2 of ft such that 

b^ 0(n\(niun 2 )). 

Using Property dhl of Theorem B.l for (</>, fi, b) and the open sets fl\, fl 2 , one gets 
(B.42) degree (0, O, 6) = degree (<£| ni , Oi, 6) + degree (</% 2 , 2 , 6). 



Using Property mil) of Theorem B.l for (4>\zj^-, fto,b) and the open sets fli, £1 2 , one 
gets 



(B.43) 



degree (<f>\^, il ,b) = degree (</>| ni , fix, 6) + degree (</% 2 , fi 2 , 6). 



Equality (B.41) follows from (B.42) and (B.43 I 



Let us now give two propositions that we have used in this book to compute 
the degree of a function. The first one is: 



Proposition B.12. Let (0,0, 6) G D. iei ,4 G £(R n ;R n ) &e invertible. Then 
(B.44) degree (A o </>, fi, A6) = Sign (det A) degree (0, ft, b). 



Remark B.13. From (B.4), one has, for every nonempty bounded open subset 



fl of E" and for every b g dfl, 

degree ( A \^,fl,Ab) 



if b <£ ft, 

Sign (det A) if be ft. 



Hence ( |B.44 1 is a (very) special case of the multiplication theorem, due to Jean 
Leray [3131 1314] (see, e.g., [3331 Theorem 2.3.1, page 29] or [4381 Theorem 3.20, 
page 95]), which gives the degree of the composition of two maps. 
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Proof of Proposition B.12, Using (B.4), one first proves (B.44I if (p is of 



class C in CI and if b is a regular value (i.e., if (B.3l holds). Then, using the 



continuity of degree (tp, CI, ■) (see Proposition B.9l and the Sard theorem as in the 

on page 



proof of Proposition B.5 



385 one deduces that (B.44l also holds if (f> is 



of class C 1 in CI even if b is not a regular value. Finally, the case where <f> is only 
continuous on CI follows from this preceding case by a density argument and the 



continuity of the degree with respect to the function (Property (mi|) of Theorem B.l 



on page 379 1 



The second proposition is: 

Proposition B.14. Let m and n 2 be two positive integers. Let Cl\ (resp. Cl 2 ) 
be a nonempty bounded open subset ofW 11 (resp. W 12 ). Let 



Ci-.= i r 1 \; Xl eCi l ,x 2 eCi 2 \ Cl" 1+ " ! . 

Let (/) e C°{Ch;R ni ) and i/j G C°{Tl;R n2 ). Let b x e K™ 1 and b 2 £ R" 2 be such that 



1> 



Let b € M"i+ n 2 be defined by 



<j){Cl 2 

{x 2 ) + b 

X2 



>l C ili, 
1 ) + b 2 ,Vx 2 e dCl 2 . 



2 J 



Let U e C°{Cl;R ni+n2 ) be defined by 



U 



'xi - (f>(x 2 ) 
'xi" 



Tp 



X 2 



Vxi e Hi, Va: 2 e Cl 2 . 



Finally, let V e C°{Cl 2 ;R n2 ) be defined by 



V(x 2 ):=iP 



4>(x 2 ) + 6] 



x 2 



, \/x 2 e Ci 2 . 



Then 
(B.45) 



degree (U,il,b) = degree (V,Cl 2 ,b 2 ) 



Proof of Proposition [BTT4I One proceeds as in the proof of Proposition |B. 12] 
One first treats the case where <f> and ip are of class C 1 in Cli and CI respectively and 
& is a regular value (for U). For this case, one points outs that if (xi, x 2 ) G Cli X il 2 
and x := (xi,X2) tr , one has 



/ Id ril -<j>'(x 2 )' 



:i!ii) 
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Hence 



det U'(x) 



In particular, if x\ 
(B.46) 



h 



det 



Mr, 

dtp 
\dxi 



(x) 



-#c 2 ), 





dtp dtp 

(x) ' 



dx 2 

dip 

dx\ 



dxi 
x)cp'(x 2 ) 



(x)(p'(x 2/ 



det U'(x) =det V'(x 2 ). 
Using (B.46 1, one readily gets (6.451 if <p an d ip are of class C 1 in fii and 57 



respectively and 6 is a regular value (for U). Then one removes successively the 
assumption that & is a regular value and the assumption that (p and tp are of class 
C 1 in f2i and fl respectively. ■ 



Let us now deduce from Theorem |B . 1 1 on page [379] the homotopy invariance of 
the degree (Proposition B.8 I and Proposition B.10 the Brouwer fixed-point theorem 



for a closed ball, which have been used in this book. 

Theorem B.15 (Brouwer fixed-point theorem for a closed ball). Let R 6 
(0,+oo), B R := {x G R"; |a;| < R] and B R = {x G R"; |ar| < R} be the clo- 
sure of Br in R™. Let T he a continuous map from Br into itself. Then T has a 
fixed point. 



Proof of Theorem |B.15[ If PF has a fixed point on OBr, then T has a fixed 
point in Br. Therefore, we may assume that T has no fixed point on 8Br. Let 
H : [0, l]xB H ^ R" be defined by 

H(t, x) = x- tF(x), V(t, x) e [0, 1] x B R . 

Note that if(0, ■) = Id„|^j and if (1, ■) = Id„|g — T . Let us check that 

(B.47) H(t, x) ^ 0, V(t, x) G [0, 1] x OBr. 

Indeed, since, for every x G Br, |.F(a:)| ^ R, 

(H(t,x) = and \x\ = R) => (t = 1 and T{x) = x), 



which, since T has no fixed point on 8Br, proves (B.47 1. Using (B.47 1 and the 



homotopy invariance of the degree (Proposition B.8 1, we have 

degree (Id„ \b r ,B r ,0) = degree (H(0, ■), B R , 0) 
= degree (H(1,-),B R ,0) 



degree (Id 



"I Be 



?,B R ,0), 



which, together with Property (m) of Theorem B.l 
(B.48) 



on page 



379 implies that 



degree (Id„|;g H - T, B R , 0) = 1. 



However, from Proposition B.10 and (B.48 1, one gets 

0G(Id„| 5B -^)(Bfi) ) 
i.e., T has a fixed point in Br. This concludes the proof of Theorem |B.15| 
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More generally, one has the following theorem. 

Theorem B.16 (Brouwer fixed-point theorem). Let K be a nonempty bounded 
closed convex subset of W 1 . Let T be a continuous map from K into itself. Then 
T has a fixed point. 

Proof of Theorem |B.16[ Since K is compact, there exists R > such that 
K C B R := {x G R"; x G R"}. 

Let Pk be the projection on the nonempty closed convex subset K of 1". Let 

f : Br , -> R" be defined by 

?(x)=T(P K (x)),Vx£B R . 

One has J -'(Br) C K C Br. Hence, using the Brouwer fixed point for a closed ball 
(Theorem B.15I, T has a fixed point, i.e. there exists x G Br such that 

(B.49) fix) = x. 



However, (B.49) implies that x G T{Br) C K. Hence, since T = T on K, x G K 
and is a fixed point of T . This concludes the proof of Theorem |B.16| ■ 



Let us now prove two Schauder fixed-point theorems used in this book (see, e.g., 
|347] by Jean Mawhin or |512] by Eberhard Zeidler for many other applications of 
these theorems). The first one is the following. 

Theorem B.17. Let E be a Banach space. Let B be either E or a nonempty 
(bounded) closed ball of E. Let T be a continuous map from B into itself. Let us 
assume that the image of T is included in a compact subset of E . Then T has a 
fixed point. 



Proof of Theorem B.17 Since a compact set is included in a (bounded) 
closed ball, we may consider only the case where J 7 is a continuous map from a 
nonempty (bounded) closed ball B into itself. Let us denote by || ■ ||b the norm 
of the Banach space E. Let us assume, for the moment, that the following lemma 
holds. 

Lemma B.18. For every positive integer n, there exist a finite dimensional 
vector subspace E n and a continuous map T n from B into B (~l E n such that 



(B.50) 



1 



\\T{x) - T n {x)\\ E ^ -,Vx&B 



Applying the Brouwer fixed-point theorem (Theorem B.16) to T n \BC\E n i there 
exists i„6Bfl E n such that 



(B.51) 



J~n\-Kn) — X n . 



From (B.50 I and (B.51 1, we get 
(B.52) 



\\x n - T(x n )\\ E < -• 
n 

Since IF(S) is included in a compact subset of E, we may assume, without loss 



of generality, that (.F(:En))n6N\{o} is a convergent sequence. Then, by (B.52 1 
(in)neN\{o} is a l so a convergent sequence, i.e., there exists x G B such that 

(B.53) x 



x as n 
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Letting n - 

This concludes the proof of Theorem |B.17| assuming Lemma |B.18 



oo in (B.52) and using (B.53I, we get that a; is a fixed point of T . 



It remains to prove Lemma B.18 Let n be given in N \ {0}. Since T(B) is 
included in a compact set of B, there exist k G N \ {0} and k elements b\, . . . , bk of 
B such that 



(B.54) 



T{B)C [j%l/n), 



where, for b G E and p > 0, B(b,p) := {x G E; \\x — 6||b < p}. Let E n be 
the finite dimensional vector subspace of E generated by the set {&]_, . . . , bk}- For 
ie {!,..., k}, let A 4 G C°(B) be defined by 



Xi(x) := max < 0, II^Oc) 

n 



■i\\ E },Vx£B. 



By(B.54l, 



^2\j(x) > 0, Vcc G B 

Then, the map J- n '■ B — > £*„ defined by 

' Ai(») 



•^(V) := XI 



^E,=i^(x) 



i, Vie G 5, 



is well defined, continuous and takes its values in B. Moreover, 

k 



\\T{x) - T n {x)\\ E 



E 



\i{x) 



(B.55) 



^ 



E 



'3- 



i Hj=i^j( x 



-(F(x) - b 



■i E 



i=i E i= iAj(a: 
However, since Aj(x) = if ||^*(x) — bills ^ l/ n 



11^(1) -ftillB, VxGB. 



\i(x)\\F(x) - hy ^ -Xi(x), Vt G {1, . . . , fc}, Vx G B, 



which, together with (B.55), implies that 



\\F(x) - F n (x)\\ E <: -VieB. 
n 

This concludes the proof of Lemma |B.18| and of Theorem |B.17| 



The second Schauder fixed-point theorem is the following one. 

Theorem B.19. Let E be a Banach space, K a nonempty compact convex 
subset of E, and T a continuous map from K into K . Then !F has a fixed point. 



Proof of Theorem |B.19[ Proceeding as in the proof of the Brouwer fixed- 
point theorem (Theorem B.16 1, we get Theorem B.19 as a corollary of the previous 



Schauder fixed-point theorem (Theorem B.17 on the preceding page) and of the 
following extension theorem due to James Dugundji [151] , 
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Theorem B.20. Let E be a normed space and C a convex subset of E. Let X 
be a metric space, Y a nonempty closed subset of X , and f a continuous map from 
Y into E such that f(Y) C C . Then there exists a continuous map f from X into 
E such that 

(B.56) f(v) = f(v),VyeY, 

(B.57) f(X) C C. 



Remark B.21. Theorem |B.20| generalizes the Tietze-Urysohn extension theo- 
rem, which deals with the case E = R. 

Indeed, let us apply Theorem |B~20| to E := E, C := K, X := E, Y := K 
and / := T . Since K is compact, there exists R > such that K C Br := {x G 
E; \\x\\e =% R}, where || • \\e denotes the norm on the Banach space E. Then, if 
T := f\-g , T is a continuous map from Br into itself and J- (Br) is included in the 
compact set K. Hence, using the previous Schauder fixed-point theorem (Theorem 



B.17), T has a fixed point, i.e., there exists x G Br such that 



(B.58) F(x) 



However, (B.58) implies that x G T(Br) C K. Hence, since T = T on K, x G K 



and is a fixed point of T . This concludes the proof of Theorem B.16 assuming 



Theorem IB. 201 

Proof of Theorem |B.20[ Let us denote by d the distance of the metric space 
X and by || • ||js the norm of E. For a nonempty subset A of X, let us denote by 
d(-,A) the distance to A: 

d(x, A) := inf{d(x, a); a & A}. 

Let z € X \ Y. Since Y is a closed subset of X , d(z,Y) > 0. Let uo z be the open 
ball of radius of d(z, Y)/2 centered at z: 

d{z,Y)' 



(B.59) u> z := < x e X; d(z, x) < 

Since z € lu z C X \ Y , 

X\Y= |J w z . 

z<EX\Y 

One can associate to this covering of X \ Y by open subsets a partition of unity, 
i.e., there exist a set / of indices and a family (A,),g/ of continuous functions from 
X \ Y into [0, 1] such that the following three properties hold, 
(i) For every z € X \ Y, there exist an open neighborhood V z of z and a finite 
subset I z of / such that 

(z' G V z and i G I \ I z ) => Xi(z') = 0. 
(ii) For every z G X \ Y , 

(B.60) ^Ai(«) = l. 



(Note that, by m, the sum in (B.60 1 has only a finite number of terms which 



are not 0: For i G I \I Z , \i(z) = 0. 
(iii) For every i G /, there exists z, € X\F such that the support of A,j is included 
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(See, for example, |65| Corollaire 1, Section 4 and Theoreme 4, Section 5], or [158 
together with |418| .) For each z G X \ Y, let us choose y z & Y such that 

(B.61) d(y„w z ) < 2M{d(y,u z ); y G Y}, 

Then, one defines / by 

(B ' 62) ~ f{x) = I eL Ms)/(v*) Vxex\Y 



Clearly, / satisfies (B.56I, (B.57I, and is continuous in X \ dY . Let y G dY . The 
only nonobvious property to check is that, if (a;„)„ S N is a sequence of elements in 
X \ Y converging to y as n — ► oo, then f(x n ) — > /(y) asn-» oo. Let a; G X \ Y 
and let % G J be such that Xi(x) 7^ 0. Then, by dm]), a; G ui Zi and Zj G X \ Y . We 
have, using (B.59) and (B.61 1, 

d(y Zi , x) ^ ^(?/zi j &zi) + 2 x the radius of the ball w Zi 
(B.63) ^ 2mi{d(y',u> Zi );y'€Y} + d(z i ,Y) 

^ 2d(y,x) + d{z t ,Y). 



Moreover, using again (B.59 I, we get 

d(zi, Y) ^ d(x, Y) + d{x, Zi) < d(x, Y) + 

which implies that 

(B.64) d(zi, Y) ^ 2d(x, Y) < 2d{x, y). 



d(z t ,Y) 



From (B.63 I and (B.64 I, we get 

(B.65) d(y z .,y) ^ d(y z .,x) + d(x,y) ^ ^d{x,y) +d(x,y) =5d(x,y). 



Coming back to the definition of /, we obtain, using (B.60) and (B.65 I, 

||/Gc) - f(y)\\ E ^ E MaOII/foO - f(y)\\ E < s( x ), 



iei 



with 



6(x) := sup{||/(y') - f(y)\\ E ; y' G Y,d{y' lV ) < 5d(x,y)}. 



Since S(x) — > as x — > y, this concludes the proof of Theorem B.20 



Remark B.22. If X is a Hilbert space (or more generally a uniformly convex 
Banach space) and Y is a nonempty closed convex subset of X, one can simply 
define / by 

f(x) := f(P Y (x)), Vx G X, 
where Py is the projection on Y . 

Let us end this appendix with the two following exercises. 

Exercise B.23. We take n=\. 
1. In this question Q, is a nonempty bounded open interval: 

fl := (a, 0), with — oo < a < (3 < +oo. 
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Letcj)£C {n) = C°(n;R) andletb£R\{<j)(a),(j){P)}. Prove that 

( 1 if4>(a)<b<4>(0), 

(B.66) degree {<f>, fl,b) = < -1 if (j)(/3) <b< <f)(a), 

{ J/6^(0(a)^(/3))U(^(/3),<A(a)). 

£. In this question £1 is a nonempty bounded open subset of K. It is the 
countable disjoint union of its connected components. In other words, there 
exist a set I which is either finite or equal to N, two families of real numbers 
(a,-)j e /, {fii)iei such that 

a, < fa Vi € /, 

(ai,[3i) fl (aj,/3j) = 0, V(i, j) £ J suc/i that i ^ j, 

n = \J(a u p l ). 



iei 



Prove that 



dfl=\J{a l ,P l }. 
iei 
Let <j> £ C°(0) and b £ K \ ^(dft). Let 

I(6):={»el;&e#(ai,ft))}. 

Prove that 1(b) is a finite set and that 

degree (</>, ft, 6) = J^ degree (^[^.ft], [pa, Pi), &)• 

i£J(6) 



Exercise B.24 (Generalization of the integral formula (B.36 )). £ e£ (0, 57, 6) e 
D be such that <f) is of class C 1 in 0. Let f £ C°(K") satisfying (B.28) be such that 
the support of f is included in the connected component o/K n \ (j)(dCl) containing 
b. Prove that 



(Hint. Note that, by Proposition B.9 
the connected component of 



degree (0, O, b) = / f(4>(x))J (t ,(x)dx. 
on page 



381, degree (4>, O, •) is constant on 



\ <fi(dQ) containing b. Use a suitable partition of 



unity, (B.23) with f adapted to the partition of unity, and (B.36). For partitions 



of unity on open subsets of ] 
Theorem 6.20, page 147] .) 



see, e.g., 342, Theoreme 1.4.1, page 61] or [419 
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Page 11, line 10, a comma is missing after "by induction on i" . 
Page 17, in the definition of M, "— n + 1" has to be replaced by 



2" . Hence the definition of M is 



M 



/I Pi Pi(Pi-l) 
1 P2 P2{P2 ~ 1) 



\1 Pn Pn(Pn-l) 



Pi(pi-l)(pi-2) 

P2(P2 - 1)(P2 -2) 
Pn(Pn - l)0?n ~ 2) 



{Pi-n 
(p 2 -n 

■ {p n - n 



2)\ 

2; 

"2)7 



Page 20, in (2.20), u J^{y{0,x) - y () (x))(t)({) 1 x)dx'" has to be replaced by "/ Q L (y(0,x) - y o (x))(j)(0, x)dx" . 

Page 26, a dot is missing at the end of the formula line -14. 

Page 47, line 13, "C°([0, 77/2], iJ 3 (0, L))" has to be replaced by "C°([0, ry/2]; H 3 {0, L)f . 

Page 52, in (2.198), "C(U,D(A*)') n has to be replaced by «C(U; D(A*)') n . 

Page 58, line -4, "i/ 3 int H2" has to be replaced by "7J 3 into 7J 2 " • 

Page 53, line 5, A*(f> has to be replaced by A*(p. 

Page 79, equation (2.393) has to be deleted. 

Page 82, in equation (2.420), a n has to be replaced by ai, and R™ has to be replaced by E ( . 

Page 95, line 8, H%(I;C) := {ip e ^((0, L); C); p(0) = <^(L)} has to be replaced by H£(I;C) := {tp e 

H 1 (I;C);<p(-l)=y>(l)=0}. 

Page 109, line 11, j has to be replaced by — — -. 

Page 128, in Example 3.9, (4>, 9, ip) has to be replaced by (0, 6, ip) tr . Similarly, (wi, ^2, ^3) has to be replaced 

by (wi,w 2 ,w 3 ) tr . 

Page 130, in (3.130), B(t) tT R(T u t) tr has to be replaced by B(t, z(i)) tI R z (T 1 ,t) tr . 

Page 132. In (3.30), er) k+1 has to be replaced by (— l) k er) k+1 and \rj\ can be replaced by 77; line -13, e € [0, £0] 

has to be replaced by e G [— £o,£o]; line -8, —rje has to be replaced by ije; line -6 and line -5, (— l) fe has to 

be deleted; line -4, e G [0,+oo) has to be replaced by e € ( — 00, +00); in (3.32), (— l) k has to be deleted and 

er) k+2 has to be replaced by \e\r] k+2 . 

Page 133. Lines 1-2, r/ = £ 1 /( 2fe + 2 ) has to be replaced by r\ = |e| 1 /( 2fe + 2 ); in (3.34), e 3 / 2 has to be replaced 

by (-l)fc e | e |V2 a nd ( £ (3/ 2 )+(i/( 2 fe+ 2 ))) has to be rep laced by (| e |(3/ 2 )+(i/( 2 fc+ 2 ))). 

Page 142, line 6 "Our" has to be replaced by "Our". 

Page 145, 

Span {61, S{h) J _1 6i5(w) J~ V w G Span {61, S(bi) J _1 &i}} 



has to be replaced by 



Span ({61} U {S^J^u); uj € Span {61, 5(6i) J _1 6i}}). 



Page 152, in Corollary 3.41, "T " has to be replaced by "0" and "Ti" has to be replaced by "T" . Moreover 

a comma is missing after "x(T ) = a; ". 

Page 196, line 10, " if /„ a(t)dt is large enough" has to be added after "around y is controllable" 

Page 199, line -12, "In [244,245]," has to be removed. 

Page 208, line -4, u g e C 2 ([0, 1]; E)" has to be replaced by "g e C 2 ([0, 1]; E)" . 

Page 210, line 10, "g e C 2 ([0, 1];E)" has to be replaced by "g e C 2 ([0, 1];E)". 

Page 210, line 10, "gi £^([0,1];!)" has to be replaced by " gi E ^([0, 1];E)". 



Page 210, line 13, u g 2 G C°([0, 1]; R)" has to be replaced by u g 2 G C°([0, 1];R)". 

Page 236, line 16, V G L°°((0, T); R m )" has to be replaced by V and v 2 , both in L°°((0, T); R m )," . 

Page 275, line -16, "the set of polynomials" has to be replaced by "the set of real polynomials". 

Page 288, line 13, "dynamic feedback laws" has to be replaced by "dynamic output feedback laws". 

Page 297, line - 11, "and Theorem 3.18 on page 134-135" has to be added after page 135. 

Page 302, in (11.75), "Va: G R n " is missing. 

Page 311, line 2, "(cci,r 2 ,t) G R 3 has to be replaced by {x\, x 2 , i) tr G R 3 ". 

Page 336, line -6, "but where the method introduced" has to be replaced by "where, however, the method". 

Page 348, line 1, "C(U, D(A*)')" has to be replaced by "C(U; D(A*)')". 

Page 368, in Lemma 13.15, "\a(t, x)\ + \b(t, x)\ < S3" has to be replaced by "|a(i, x)\ + \b(t, x)\ + \a x (t,x)\ + 

\b x (t,x)\<6 3 ". 

Page 368, line -3, "Proposition 1.18" has to be replaced by "Proposition 1.3". 

Page 387, line -11, "&' G R n " has to be replaced by "&' G R™" . 

Page 404, in reference [150], "Karlruhe" has to be replaced by "Karlsruhe". 

Page 405, in the title of the reference [200], "controllabilty" has to be replaced by "controllability". 

Page 416, the two references [416] and [417] are the same. 

Page 421, line 14 "H$(I; C) set of tp in H l {I; C) such that p(0) = tp(L) = 0" has to be replaced by "H^(I; C) 

set of ip in H l {I; C) such that ip(-l) = <p(l) = 0" 



